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INTRODUCTION 

This publication is a companion to WESTAR Series Paper //1 3, Program Evaluation in Early 
Childhood/Special Education; A Self-Help Guide for Practitioners , by Dr. Ellis Evans. While 
the earlier paper offered a general, and more theoretical, int^duction tg^ the evaluation 
process, ^is publication presents spmples of actual program evaluations performed- by HCEEP 
projects. It includes narrative histories of the staffs experiences, their decisions and the 
Tessons they learned, as well as samples of the forms and tables they developed. ^ 

There dre many ways to approach evaluation. It is hoped that the variety of techniques 
covered in these two Series Papers will help guide program administrators and project staff in 
conceptualizing, developing, and carrying out a plan that is best for their particular program. 
Together,' the papers should serve as an overall introduction tp program evaluation for staff 
with little experience in this afea and should provide helpful suggestions for improving ongoing 
evaluation of programs. ^ 

This paper includes two case studies. The first is by Amy "toole of the Regional 
Development Program XRDP) in Yorktown' Heights, New York^ This case study covers the 
project's three years as ^n HCEEP Demonstration project. (It is now funded as an Outreach/ 
project.) This is a personal and informative history, clearly for and about early childhood staff. 
In'^the paper, Toole takes us from the project's beginnings, when "no one on the staff had any 
background in evaluation or complete understanding of its importance" through a detailed 
description of how to prepare for a JDRP submission. She includes recommendations on hiring 
outside evaluation consultants, solving some common evaluation problems and reporting findings 
to various' audience^. The Regional Development Program rdentifie,d four major evaluation 
themes. For each of these, thelpaper describes the evaluation plan, data sources, instruments, 
analysis, use and implementation. 

The second case study is by Linda Giij Project Director of the Northwest Center 
Infant/Toddler Program in Seattle, Washington. It includes samples of the evaluation plan for 
the key program elements along with tables showing the overall evaluation approach and a short 
history of its development. The two evaluations differ in several respects.'' While the RDP used 
outside evaluation consultants, the Northwest Center's director developed her own plan, with 
guidance from the technical assistance coordinator assigned to her project. The first case study 
is written retrospectively, looking back over three years' experience and Analyzing the lessons 
learned. The second represents an ongoing evaluation plan . It was devised during the first six 
months of the project and now, as the project enters its third year, continues to serve as a guide 
to program implementation. The two evaluations are displayed very differently, with the 
second being presented almost entirely in the form of the charts developed for the project's own 

use. V 

Although different, the authors agree on this point: the earlier evaluation is begun, the ^ 
better. Both have found that a good evaluation plan can be an important tool throughout the 
life of -he program. Both projects have been impressed^ with the positive contributions that 
evaluations have made to their program implementatian.~Ttiese are two "evaluation success 
stories", and, along with Dr. Evans' introduction to the topic, should serve to make Evaluation 
valuable and comprehensible to the most skeptical or hesitant project staff. 
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Evafuating the Regional Demonstration Program 
* Amy L. Toole 



The, Regional Demonstration ProgramKRDP) is located in Yorktown Heights, New York, in 
a state where services for handicapped preschoolers are not mandated. Legislators, local 
communities and school officials consequently have had to be convinced of the importance of 
these services by the RDP. Careful evaluative planning and implementation have proved to be 
a way of convincing these people that the RDPs work is worthwhile, even vital, to the 
community. 

This paper is an historical account of the development of RDP's evaluation plan. Jne.^ 
process that is discussed took a full three years to develop. It required t>\e aid of outside 
specialists, the hard work of staff and administrator, and perhaps some luck...8ince the basic 
evalyative plan that emerged never had to be completely dropped or redeveloped before it could 
servQ'^the progrem's needs. The goals of the plan were that it be practical for the project to 
use, ' that it provide thfe community, staff, parents and other professionals, with basic 
information about child progress and the success of, the program, and that it help the program 
prepare for the Joint Dissemination arid Review Panel (JDRP). It served these goals well. 

The chapter includes a discussion of the way evaluation specialists were employed and the 
methods they used to design an evaluative plan, the four major areas of the evaluation, the way 
findings eventually were reported to various audiences, and ideas on preparing for JDRP 
submission. ' ^■ . 

The Preschool Program; A Description 

The Regional Development Program (RDP). serves children with, a, variety of handicapping 
conditions in 18 school districts in two counties of New York Stata. The area has rural 
farmlands, suburb^ communities and several cities of 20,000 to 35,009 P^ople. ' 

.Classroom op home programs are available to eligible children^ The alternative chosen for 
a particular child depfends .upon his or her age and maturity; readin6s8 for classroom work and 
interaction patterns with the rest of the children. There ar^T four classroom sites; children are^ 
bussed to the one closest to their honnes by their local school districts. Morning ancUfterqoon 
classroom sessions are oflfered. Each follows a carefulfy structured schedule which includes 
large- and small-group activities and individual (teacher-child) work. The homfe program, which 
is primarily for children under the ^qe'of three, is a replication of the Portage 0roj6ct's Model 
(a nationally validated program). A skilled. J^iome traini^ staff member serves approximately 
ten Children and their parents through WQ*kly visits^ to the home. Special features of the 
program include a team approach involving parents al^d professionals and interactive teaching 
using language intervention, positive reinforcemerjt and diagnostic-prescriptive teaching 
techniques. . - • I 

- ■ -A 
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EVALUATING THE PROCiRAM . ^ * 

In the First Year of the Program 

When the program started, no one on the staff had any background in evaluation or any 
complete understanding of its importance. The government req^Jired that certain evidence be 
found as to the program's effectiveness^^yt the gathering of such evidence seemed a secondary 
pursuit to staff members who were mor^oncerned with serving children. Nonetheless, certain 
necessary tasks were carried ou\f 

1, A filing system to collect (iata systematically was set up. * . . 

2. A normative tes^^ for pre- and post-program callection of data was chosen. 

3, An evaluation management plan and timeline were written. * 

4, A project manual of forms and pi^ocedures uspd routinely in the program was 
developed. 

5, Videotape records of child behavior upon entry into the program were prepared. 

6. Procedures for developing Individualized Education Pla^(IEPs) were planned. 

7. Staff meetings which focused periodically on evaluafion needs and solutions were 
convened. 

8. Record-»keepinq forms were developed, including questionnaires on parent observation 
^ in the classroom, parent satisfaction, parent volunteer work, parent group meeting 

satisfaction, follow-up for children who had graduated from the program and a visitor 
questionnaire, as well as anecdotal Record, agency coordination, parent * services 
- Record and lEP forms. (See Appendix.) It was not known exactly how ti^e resulting 
data would be used; enough was gathered to allow flexibility in" setting a strong design. 

In all of this, the Technical Assistance Development System (TADS) played a periodic role. 
At first, the Needs Assessment Survey from TADS became the basis of the project's Evaluation 
Management Plan. The Assessment, which was completed during the fall of that first year, had ^ 
four major areas which became the center of the evaluation management plan: Services to 
children. Services to parents. Staff development and Demonstration and dissemination. . 
Appendix 1 is an example of a draft of the first evaluation plan. 

TADS also sent an evalua nr to cohsult with the project director durihg the first year. As a 
result of the consultation a series of questions was prepared for each of the program's goals. 
The answers to these questions would determine the level of the project's success.. These early 
questions therefore became guides for the evaluation. Alongside each group of questions, the 
people who "would need the answers were listed. All of this information helped focus the 
evaluation plan that would ultimately be developed (s^e Appendix 2). 

Eyaluators 

The RDP had originally planned to hire one person as an in-^jpuse evaluator, believing that 
a staff person could better understand the nature of the program and develop appropriate^ 
techniques for use with young children and for specific audiences such as the JDRP. 

Interviews w^re held and a caryiidate dhosen, but the candidate later decliijpd; and in the 
end, an outside evaluation consulting firm was retained: The Center for Resource 
Manlgement. (This firm had bqen recommended by the Director of. funded programs ^ 
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of The Board of Cooperative Educatron Services (BOCE^), fiscal agency for the Outreach 
program.) The benefits of using outside evalu^ion consultants were nurnerousw For the same 
amoursf of money that had been set aside for a^teff person, the consulting firm provided the 
following: ' / 

1. Several individuals collaborating and using a differentiated staffing model. 

2. Computer time for no additional costil 

3. A knowledgeable group of individuals with many resources (e.g.,' research' 
departments). 

4. Access to information about approaches used throughout the nation. . 

5. An objective group who had no individual investment in the agency's success. 

6. A firm to take complete responsibility for designs and implementation, thus taking 
the burden off the administrator. The administrator could re^y on the evaluation 
team to provide recommendations and feedback without pronn(|)ting. 

Furthermore, the consulting contract allowed for reimbursement by task and timeline, thus 
ensuring completion. A staff 'evaluator would- have been paid every two weeks whether or not 
tasks were finished. The advantages of the contract system were so strong that they virtually 
alleviated the need for the RDP to identify other evaluative aids such as research sources, 
computer analysts, etc. A tribute to the success of the evaluation is that thd RDP continues to 
incorpSfiate evaluation into its local budget after federal funding for those services has been 

terminated. ^ '• ' . . 

In order for the experience of working with an outside consulting firm to be a positive one,, 
the RDP found that it is important to take the initiative with the evaluators in several ways. 
Figure 1 offers a summary of procedures and agreements which we found to be essential in 
reaching a satisfactory working arrangement. , j • ^ 

The Evaluability Study and Evaluation Design 

The second year, evaiuatocs were hired, and they prepared an evaluability study^ In this 
study, the project was reviewed to determine whether it had been implemented in sucfi a way 
that its impact could be evaluated. Specifically, we wanted to know if it could be evaluated so 
as to meet the stringent evaluation criteria of the JDRP. (It was assumed that if evaluation 
information Was appropriate tor the JDRP, enoug^i data would have been collected to satisfy* 
other audiences.) This review identified those practices which could prdvide essential data for 
formative and summative evaluation and those activities which were not essential to the JDRP 
criteria. Results indicated that enougti information would be available from the project In 
order to evaluate statistical and educational significance, generalizabilUy, comparative 
assessment and replicability. It was also agreed that the instruments being used were reliable 
and valid. 

The review found that some evaluation procedures being used were not needed, thus 
lessening staff work rather than increasing it. Another result of the Audy was that evaluation 
needs were determined, and corrective measures to respond to the needs were suggested. (One 
need, for example, was to better define the nature of the program's intervention, its objectives, 
and the relation of these to child chgnge.) Multiple measures were also suggested as a 
methodology which would help rule out rival hypotheses. 

The next step was to develop an evaluatiorf design. This involved many discussions between 
the program administrator and^the evaluation consultants. The following information formed 
the guidelines for that design: • 
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FIGURE 1 
Hiring Outside Evaluators 



• BEFORE YOU SIGN ON THE DOTTED LIN^... 

1. Meet and describe your program. Get a feeling that they understand your goals. 

2. Share all of ybur written materials so they have a sense of your program's character 
and focuses.' 

3. Discuss evaluation questions you would like answered. (These may include issues both 
directly and indirectly related to project goals and may range from family change, 
social interaction and foUow-L'p after graduation, to operation of the program itself.) 

4. Discuss possible audiences for the evaluation^ 

5. Ask fo> a wrrtten report of the work scope they propose and for samples of past work. 

6. Choose individuals with experience in evaluating handicapped children. 

7. Choose individuals sensitive to the staff's concerns about evaluation. Discuss issues 
openly with the evaluators. ' ' ^ 
Ask for, an analysis of the evaluability of the program and samples of design, 
implementation and report time frames. 

9. Explain that the evaluation design must include evidence of child change and that the 
following points must be addressed in the design: a.) s£atistical significance, . b.) 
educational significance, c.) generalizability, d.) comparative assessment, e.) 
reliability and validity of instruments, f.). evidence of replication, g.) nature of 
intervention, h.) multiple measures, i.) ruling out of rival hypotheses. 

10. Discuss fees: each person shoul^d have a per diem charge, and the amount of thne 
proposed for the plan should appear to, be reasonable for the work scope. 

1 1. Interview several firms or individuals before deciding. 

12. Have^the contractor submit an agreement which includes: a.) services and products 
to be delivpred, b.) specific names of personnel, c.) reports and instruments to be 
prepared, d.) per^iem costs by task, e.) payment schedule, f.) feedback system, g.) 
length of agreement, h.) standard-of-work clause, i.) governing law 

Remember... 

It*is impoi:tant that you like and trust the people with whom you will work. Evaluators not 
only have to work with charts and figures, they also have to interact with children and 
staff. They must understand the needs of special preschoolers and their families. They 
must' be sensitive to the needs of the staff. All of their testing activity must fit 
comfortably within the classroom program. They have to understand that as a public 
school-based program, resources may be scarce. There are usually no graduate students 
to help out* Thus, the design must be practical and efficient and must yield results. The 
design cannot be a classic research evaluation plan where a control group is used. If you 
are not satisfied and comfortable with the consultants' approach, if you do not respond 
positively on an intuitive level, continue to look. 



A statement of the program's theoretical frameworks . 
A summary table , including instruments, criteria, timelines and persons responsible 
for each part of the evaluation. 
' *A schedule of meetings with consultants. 
An evaluation mpnitorinq system which would allow redesign and improvements to be, 
made along the way. 7 * » ' 

A list of existing evaluation techniques. 

A process for sharing results with staff. ^ 
Solving^he Key Evaluation Problems ^ 

Problems were pinpointed through the evaluability study and general discussion, and^ 
solutions were suggested. They are summarized below. 

Problem:* How can we be'sure-that the intervention made' the difference? 

Solutions; ^. Rule out of the study children who attended any other clinic, nursery 
7^ school, etc. • 

2. Use an implementation study to indicate that the intervention was 
occurring. ^ 

3. ^ Use a normed instrument, which by virtue of its design, takes maturation 

into account. 

4. Analyze the data across four classroom sites to demonstrate equal 
effectiveness of intervention regardless of teacher. 

5. Use multiple- measures to show improvement, e.g., lEPs, McCarthy Scalps 
of Children's Abilities, teacher observations, anecdotal reports. 

6. Use a multiple baseline approach with base'line data on the »8kill8 in the 
area of the child's handicap prior to the intervention, when the 
intervention begins, at the compl^ion of the intervention, and after 
summer vacation. The assumption is that the child will maintain but not 
improve skills over the two-month summer break. V. 

7. Plan for the testing effect to avoid the quandary: Did administration of 
the same test over time influence the result? Use statistical analysis to 
compensate for this problem. 

8. ' Plan for statistical regression by employing statistical analysis. 

9. Analyze the attrition rate to ensure that children dropping out of the 
program do not differ significantly from children remaining in the 
program. • 

Problem ; How can we gain staff cooperation? » 

Solutions; 1. Hpld preliminary tneetings with staff to receive their ideas and feelings. 

2. * Involve staff in developing idSas which become the bases for forms and 

procedures. 

3. Give staff advance notice, in y/riting, when classes will be visited. 

4. Giv? staff the evaluator's feedback regarding their implementation of the 
intervention. This will eliminate staffs concerns thae th? program 
evaluation is being used by the agency to evaluate their teaching. , 



5. Give staff immediate^ feedback regarding the McCarthy test results so 
that the test becomes a useful diagnostic instrument, not jus^ an 
evaluation tool. 

G. Give staff sets, of forms and instructions to keep in their classroom. 

Problem : Is the intervention good for all handicapping conditions and types of children? ^ 
Solutions: 1. Analyze data by -sex, morning and afternoon sessions, handicapping 

^ conditions, socio-economic status, and demographic ^area. Keep records 

for eas^ analysis at end of evaluation period. 
* 2. Have th6 staff of at least one replication site trained ^and implementihg * 
the program by the completion of the thiftj year, so that data from an 
\outside site with no direct program admini|trative control ia» also 
available. ' ^ 

Pro blem ; How can the evaluation consultant's calendar be coordinated with ^he administrators? 
S olution: ■ 1. Set timelines and meeting dates at the beginning of the year with a 

" schedule that allows for interim feedback and revisions. Also, build on 

ways to help the administrator gain a greater understanding of the process 
and terminology and to monitor th? desi^ for best results. 

Problein: How should Che progharh intervention be described? 

Solutions: 1. H^w-^Vogram sta.ff prepare a.description of the curriculum process in the 

second year. ^ , , 1- 

2. Build into th& schedule planning and writing sessions with ^valuation 
consultants so that the program description and theory are accurately 
stated based "bn the' curriculum. ' ^ 

The Evaluation Themea ' ■ ^ ^ 

After the evaluators preparec) the initial study, they begah to work with the programs 
personnel to identify the major evaluation themes. They were: 

1. Measuring the implementation and' impact of the classroom progra m on chUdren and 

f amilies. . . . ^ . ^ ..u 

This meant, first, determining whether the program had been implemented as planned, then 
^Identifying and measuring thos^ outcomes that were related to the goals of the program and 
were truly measurable. For children^, these were determined to be verbal skills, perceptual 
performance, ' motor and general cognitive skills. For families, parent perceptions and 
understanding 'of their child's development and their satisfaction ;^vmi the program were the 
kinds of data soi^ght. ^ , ^ 

. 2. Measuring the implementation and impact of the home program on ch ildren and tamiUea. 

Since the home program was a replication of a nationally validated program (Portage), its 
effectiveness did not heed re-evaluating. Data was needed only to make sure it was being 
properly implemented and results were being obtained (as appropriate). 
3. Meas uring the^long-range effects of the program . 

Data on long-range effects were needed to convince the public and funding agencies of the 
^ efficacy of the work done by the RDP. As in most designs for evaluation, this area^wap a 
priority. 



4. Measu ring the amount of demonstration and dissemination activities and agency reactions 
to the program , 

rThis information was needed for funding sources and for staff so that awareness and 
training patterns could be improved.^ 

Based on these four themes, staff and evaluators developed a list £)f questions to guide the 
evaluation: 

U Implementation of Classroom Program 

a. Were the key elements implemented at an acceptable level? 

^ b. • Did the staff have the knowledge, understanding and expertise to implement the 
innovation? Were they philosophically in agreement with the project's goals? 

2. Impact of Classroom Program 

' a. Did the children improve in verbal, perceptual-performance, general cognitive 
and motor skills? 

b. What percentage of the educational objectives for the children (average) were 
mastered? 

c. . Were parents satisfied with the results of the program? 

3. Long-range Effects 

a. What was the status of children who had graduatec^ from the jDrogram with 
regard to: placement, retention of gains, the need for special services? 

b. How did teachers^aBclj)arents rate the children's performance in their present 
placement in terms of acerdetnic activity, social ability, pee^* interaction and 
attitude toward school? ^^"^^--^ 

4. Interagency Collaboration ♦ 

a. How did agencies react to the RDP? 

b. How did they perceive the program? 
Of these four areas, 2 and 3 became the most important in the project's development of 

materials to submit to the Joint Dissemination Review Panel. All of the questions were, of 
course, useful to the project-and continue to be— in improving service and keeping setyices 
consistent. 

The process qf arriving at these questions took, In fact, three years. Measuring the 
classroom program wai. a goal from year 1; implementing* the specific design was a goal in year 
2; and long-range impact and agency reaction to the project became important in year 3. As a 
program evolved, evaluators and staff had to keep searching and questioning, until evaluative 
approaches that met needs are found. These questions could be asked only when needs became 
clear. 

EVALUATING IMPLEMENTATION OF CLASS PR^RAM (THEME 1) 
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Designing a Plan ^ 

The design of the plan to evaluate implementation was based on similar designs found in 
the literature (Hall ^>c Loucks, 1978; Loucks & Hall, 1977; Morris & FitzGibbon, 1978; Fullan & 
Pomfret, 1977). However, the specific conceptual framework and design used for measuring' 
implementation were devised by the Center for Resource Management (Koen & Musemeci, 
1980, 1981; Koen, Musemeci, c5c Floan-Novesky, J 981). Three aspects of ttte program related to 
Theme 1 were examined: Usage, Technical understanding and Program receptivity. 

Usage . This variable concerned the degree to which teachers followed a set of core elements 
which were basic to the program. These elements were called: 



1. START-UP ELEMENTS— The activities and behavior patterns required to initiate the 
program (e.g., developing lEPs). / ^ . ^ 

2. STRUCTURAL/PROCESS ELEMENTS— The formal arrangements (e.g., daily routine; 
or physical conditions (e.g., classroom arrangement) under which users of the program 

operate. . 

3. ROLE BEHAVIOR ELEMENTS— The way the program staff interact with students 
(e.g., reinforcement patterns). Certain behaviors were to occuf more than once 
during each day. 

Technical understanding . This variable concerned the degree to which program users had 
internalized significant information about the program's content and structure. For example, 
understanding of program goals, philosophy, conceptual underpinnings, key components, 
classroom strategies, and subject matter were measured. 

Progra m receptivity. This variable concerned the level to which program values were 
internalized by the classroom team. For example: Did they generally accept and were they 
satisfied with the program? Were their personal values compatible with the program values? 
Did they believe in the importance of the program and in the possibility that it could make a 
difference for the children? Were they willing to disseminate the program ta others? 

Instrumentation 

To measure the degree of implementation, several instruments were developed with staff 
assistance and adopted by consensus, including a descriptive checklist of core elements, a 
role/behavior observation schedule, a staff questionnaire and a parent questionnaire. 

Observations. Two sets of observations were scheduled after agreement on the forms. The 
first set was to study the usability of the forms and to measure inter-rater reliability. An 
outside observer was hired for the activity. The second observation was to note how often core 

elements were used. . .. j 

The start-up elements were measured one time during the year by reviewing documents and 
observing and interviewing staff. A 'checklist with a yes/no format was used. The 
structural/process elements were also measured via a yes/no checklist; information was 
gathered on four days spread over two months. On each of these days, the instrument was 
completed twice, once in the morning and once in the afternoon. Thus, a total of thirty-two 
observations Vere made in the four classrooms. The role/behavior elements were measured by 
way of a nurViber of random observations. Each observation, which began at the start of a 
five-hour session, consisted of recording the teacher or aide's behavior for 15 minutes at a 
time. The observer made 10 observations (five for teacher, five for aide) during every 
15-minute block. In all, 800 observations were made at each site: 200 per day for four days 
(spread over two inonths). Program-wide (four sites) 3,200 observations were made. 

Questionnaires. The staff questionnaire consisted of five scales-knowledge, skills, attitudes, 
values compat ibility and open-ended items-designed to measure technical understanding and 

'^^'^^ The*' parent questionnaire included knowledge, attitude and commitment scales and 
open-ended items and was important in ascertaining whether the parent involvement part of the 
program was providing for the parents' understanding and receptivity. 
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Analyzing the Data 

Data collected via these instruments provided quantitative and qualitative information 
about the program. An analysis of the usage, understanding and receptivity of the program by 
personnel provided a comprehensive view of hov^^ the* program was being implemented. Data 
were analyzed as outlined below. 

Usage. Two types of frequency data were computed: 1) the number and percentage of total 
start-up and structural core elements implemented, and 2) the percentage of time that 
teachers, teacher aides and program sites were involved in activities (or clusters of activities) 
cohsistent with project role and behavioral elements. This second percentage was calculated by 
counting the number of times a particular activity was observed and dividing that number by 
the total number of observations taken. Data were analyzed for each program site and for the 
program as a whole (i.e., the program site data were pooled). 

Understanding and receptivity . Descriptive and inferential statistics were computed. 
Frequency counts, means and ranks were used to assess knowledge, attitudes, skill and program 
commitment within the four program sites and across the entire program. Analysis of variance 
was calcalated to determine any differences in ratings among the various sites. 

Using the Data 

AH data from each year were analyzed and reported by the evaluation consultants. 
Recommendations made by them on the basis of the analysis were Integrated into the program 
operation during the following year. The data helped in hiring personnel and in the training and 

supervising of staff. ■.. .£• u j 

The results of evaluation Theme 1, as analyzed and reported by the cpnsulting firm, showed 
that the program was being adequately implemented. Staff members' attitudes and behaviors 
were found, as expected, to be consistent with prograra philosophy. Consistencies were found 
across sites, among teachers and aides, and between morning and afternoon sessions. 
Questionnaire results pointed to the need for additional training and involvement of. 
paraprofessionals and more personalized involvement of parents. This led to the planning of 
new program components in each case. „ ^ ^ s » 

Results of this analysis entouraged a positive dialogue between the staff and administrator 
in regard to staff performance in the program. Staff were the main audience., for- the 
implementation study, and the results have helped them do their jobs better as the years Nave 

gone^y^ findings of thgr implementation study were genferally positive. If a weakness h6d been 
identified in program us^ge, .the impact results (Theme 2) might have been suspect. However, 
because the program was clearly being performed by personnel as decribed, assessed impact 
could confidently be attributed to the program. 

EVALUATING IMPACT OF THE CLASS PROGRAM (THEME 2) - 

Designing the Plan ■ ^ ' 

In the first year of the pl)t)gram, data were collected on a wide range of events. However, 
there was no design behind the collection to guide it properly. Consequently, more information 
than was really necessary for evaluation of impact had been gathered. Luckily, in the second 
^ year, when a design for evaluating this theme was written, much of the first-year data proved 
invaluable. 

9 
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The first step in arriving at a design for impact evaluation was to decide what should be 
evaluated. The research literature shows that goals of a program— what it seeks for its 
children— must guide the evaluation. In the case of the RDP, these included student gains 
related to verbal, perceptual-performance, motor and general cognitive skills; mastery of 
objective? in the area of the child's primary handicap; parent satisfaction with changes in their 
child's skills; student placement in school programs upon graduation frofn the -RDP; and 
maintenance of gains after students had graduated from the program. 

^ Data Sources and Techniques 

^ The next step was to identify sources of data and techniques for analysis. For legal and 
Ethical reasons, no actual control group could be established; instead program stud.ents' pre and 
post scores were compared with .available normed scores for those tests. 

Mastery of various educational objectives was assessed for all students by using lEPs. 
Student gains were measured by annual pre and posttesting. Students from the first year of the 
program for whom pre and posttest data existed and who had graduated from, the program 
received a test a year after graduation to measure maintenance of ga4ns. A number of sources 
were examined for corroboration of improvement. Documents (student records, etc.) were 
reviewed, questionnaires and interviews were given, observation occurred periodically and 
standardized tests were administered. Insofar as feasible, the evaluators used data that had 
already been collected rather than ask the staff to re-collect it. 

It was surmised that data from various sources -whieh-pointed to the same conclusion 
(convergent validity) would add weight to the results. Furthermore, if data from different sites 
showed the s^me trends, that would mean that replication of the program had produced similar 
results at the various sites. (For more information, see Koen & Musemeci, 1980, 1981; Koen, 
Musemeci, & Floan-Novesky, 1981.) ' 

Instruments 

Four instruments provided information for (neasuring program impact. 

1. The McCarthy Scales of Children's Abilities— selected for its high reliability rating, 
construct validity and correlation with other intelligence scales— was the pri^nary instrument 
for assessing verbal, perceptual, motor and cognitive gains. It was administered, to all students 
before and after instruction and to graduates after one year. All tests were administered by 
the same four graduate students -uncJer the supervision of a psychology professor. They were 

.periodically observed by the Supervisor of Preschool Programs.- 

2. An lEP Skills Checklist. This instrurrrent which identified an average of 10 skill objectives 
for each child based upon the student's lEP was used to- assess the degree to which the RDP 
children mastered specific skills within their primary handicap areas. For every objective, a 
standard criterion for mastery was also specified. Teachers completed the checklists at the 
beginning of instruction and at three-month intervals thereafter. 

3; Placement rpcords showed the educational programs to which children were assigned upon 
graduation. They documented several types of placement programs: regular nufs|jy schools, 
regular kindergartens,, transition programs, special education classes and speci|r education 
schools. The administrator maintained the records. • 
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4. The Parent Questionnaire for implementation also measured parent perception of impact. 
(This hdpted prevent parents from feeling overwhelmed with forms.) ^ 

Analyzing the Data 

The data analysis was intended to provide quantitative information on the four impact 
areas: student gains, maintenance of gains, mastery of objectives and placement upon 
graduation. These results were^omputed for individual program sites and for the program as a 
whole by pooling the site data. . , r-u i^ • 

Gains and maintenance of gains were analyzed using a norm-referenced model. Children s 
mean pretest scores were compared to mean posttest scores for each of the four McCarthy 
Scales judged appropriate for measuring the impact of the program (language, perceptual, 
motor, cognitive). A correlated t-test was used to test statistical significance (p .05, 
one-tailed probability). Educational significance was established by comparing the size of the 
pre to posttest gains to the standard deviation of the norm group. 

The percentage of "objectives mastered" between the time instruction was initiated and 
the final measurement was also-computed. The percentages were then aggregated for classes 

and for the entire program. - r . 

"Placement" and "parent satisfaction" data were analyzed using simple frequency counts 

and percentages. 
7 Using the Data 

The data analysis helped determine who should be Informed about the program's 
effectiveness. If statistical and educational significance had not appeared during the first and 
second year, for example, the goal of applying for national validation (via the 30RP) would have 
been dropped. Since significance had appeared, application plans continued. 

Although data from this analysis also yielded information on memory and quantitative 
skills, these were nqt included in presentations to various audiences since program goal«1^plid not 
center around developing these skills. ui^ • 

The model did not yield information on social-emotional growth. Since some children m 
the program had emotionally-based problems, it did not seem enough to verify only that they 
had grown cognitively. The model has since been refined to attempt to measure this aspect of 
growth through the use of behavioral checklists and observation scales. 

The lEP skills checklist had been new to the staff and required teachers to set more 
difficult criteria for mastery than had been common in the past. Iri many cases, teachers 
established standards without regard to a child's ability to change, thus the lEP findings were 
skewed by the way the instrument was used. Subsequently, training was held to teach the «taff 
how to set appropriate standards. The analysis of objectives the following year revealed an 
increase in the percent of children who mastered their objectives. The subjective nature of this 
type of analysis made the results more suited to local audiences than the JDRP. 

"Student placement" and "maintenance of gains", were consistent with other^ reported 
findings for preschool handicapped projects. These data were useful in reporting results to a 

number of audiences. . . ^ x J 

"Case studies" were used to report results. The studies were constructed trdm ceacner 
anecdotal records, reviews of the student's classroom record and Informal interviews with 
parents. These studies were used for the JDRP validation, visitor orientation packets and in 
discussions with reporters. . ^ 
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Implementation 

The design outlined all steps in the evaluation of this area and these steps were followed 
carefully. Pre and posttesting collection of lEP mastery data, and staff questionnaire 
distribution were on schedule. The only difficulty encountered was locating outside testers who 
were skilled and available for the October and May tests. The program was not in a university 
setting with graduate students easily available and was not based in a city with access to 
transportation. Arrangements were quickly made with a nearby university, however, and the 
problem never became an insurmountable obstacle. 
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EVALUATING LONG-RANGE EFFECTS (THEME 3) 



Designing the Plan 

Utilizing the Karnes design (Karrres, Shwedel, & Lewis, 1980) and procedures as a gui^, the 
RDP study (Koen, Musemeci, & Green, 1981) of long-range effects was undertaken m order to 
contrijtrate to the knowledge base in this fielql. The RDP study examined a sample of 170 
children who graduated between Janu&ry 1976 and May . 1980. , u. i_j 

The design lacked comparative data because no control group was available. However, 
data from the literature was used as a basis of comparison, and the, design also relied upon 
convergent validity. To build the case for early education, information was gathered from 
several sources which addressed similar outcomes. Two other problems typidal of studies ot 
this kind are attrition and restriction of the sample due to lack of parent permission. Since the ^ 
study was able to gather data en 40% of the( graduates-representing the total graduation 
population in terms of year of graduation, school distriqt, sex, handicapping condition and 
severity of handicap—the sample was found to be adequate. 

Instrumentation . ' , 

The current academic and so(aal performances of former students, after they had left the 
RDP program, were assessed through three data collection techniques and their appropriate 
instrumentation; 

1 A Cumulati ve Record Form allowed a wide range of current student information to be 
synthesized from a review of individual student files. Progression or retention data, special 
class/or oqram/services required, diagnostic classification, performance on standardized tests, 
and yearly grade reports were recorded. Also, more subjective items, such as teachers 
comments,/were recorded on the form. - ' 

2 A T eacher Questionnaire , developed by Karnes, Shwedel and Lewis (1980) was used to rate 
the preschool child's performance as compared to other children in the class on the .following 
variables: a) cognitive skills, b) pcademic skills, c) communication skills, d) attitude toward 
school and teacher, and e) social interaction. The instrument consisted of 25 items which 
combined five-point Likert ratings with open-ended questions. 

3 A Parent I nterview /based upon « form developed by Karnes, et al., (1980), measured parent 
perceptions of their child's performance in school and the impact of preschool upon school 
performance. It consisted of 12 open-ended items. ui i» n j 

The usefulness of employing instruments from another study was immeasurable. It allowed 
comparisons of results and saved tixne and money. 
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Analyzing the Data • * 

Data were analyzed using a number of both descriptive and parametric statistical 
techniques. Frequency distributions and percentage ra':es were used to determine assignment 
and retention information, special service requiremerits of regular education students, and 
parent and teacher ratings. A chi-square analysis was performed to determine whether 
placement in regular or special education differed depending upon the severity of handicap. 
Finally, a Kruskal-Wallis one-way analysis of variance was computed to determine whether 
school performance, as measured by teacher ratings, differed according to the age and grade of 
the handicapped preschoolers. 

Using the Data 

The findings clearly showed long-term effectiveness of the program. Its graduates, as a 
whole, are' performing adequately in school, progressing normally through the grades, socializing 
well with their peers, requiring a minimal amount of special services and achieving at a similar 
level to their peers in cognitive and academic areas. Furthermore, these children have been 
reported by both their teachers and parents to have extremely positive attitudes towards 
school. The following results of the study are significant when viewed in terms of their 
educational implications: - 

1. Placement in Nonhandicapped Classes - Participation in the Regional Demonstration 
Program has ' facilitated the placement of children within the least restrictive 
environment and enabled them to perform under the sannje expectations as other 

children. ' ^ i- ■ i » ^ 

2. In dividual Educational Plan - Precise educational planning reduced or eliminated the 
negative' effects of a child's handicapping condition, thus demonstrating the cdst 
behefits of preschool education. , - u i 

3 Placements - Decisions made by a transdisciplinary team (teacher, psychologist, 
speech pathologist, social worker and parent) regarding child placement upon 
• completion'of preschool seemed to ensure the appropriateness of that placement. 

4. Attitudes - Graduates have positive attitudes towards school, which improves their 
potential for greater school achievement in later years. 

5. Parents Involved - Parents of graduates consider preschopl education to be a critical 
factor in the success their handicapped child is experiencing in school. 

Thes^ indicators supported the efficacy of preschool handicapped education. They supplied 
information for a myriad of audiences, including staff, parents, professionals, communiCy 
members and the JDRP. The study was very important in demonstrating the programs 
appropriateness in the. community and state. . . 

Implementation 

The decision to conduct the long-range study-unlike the study of Themes 1 and 2-was not 
made .until the third year of federal funding. It was only then that the completion of the study 
by Karnes made it possible to evaluate this thematic area quickly. From planning to analysis, 

this evaluation took about 8 months. . .. , » „„■ i„ 

A research associate was employed by the evaluators to keep logs, visit elementary schools 
and interview parents. This individual also collated and tabulated the data. Interpretation and 
analysis as well as the final report were written by the evaluators. 
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EVALUATING 'COLLABORATION WITH OTHER AGENCIES (THEME 4) 



Fostering collaboration and communicatiorf y^ith other agencies has been a focus of the 
program from the first year. Numerous links were established between the^rpgram and/'Outside 
agencies, inpluding nursery schools, prekindergarten programs, toospttats, health clinics. Child 
Protective Services and other social service agea^ies. These agencies are located primarily 
within a 50-mile radius of the program's central office in Yorktown Heights, New York. 



Designing the Plan 

The design of this evaluation was concerned with three issues; 

1. Determining the types of agencies with which the preschool staff had 6stablished 
contact. 

2. Describing the nature of each contact. 

3. Determining the degree to which agencies understood the preschool program and 
perceiveti it to be a high-quality service. 

Instrulnentation * - ' \ 

Information regarding the type and extent of interagency collaboration was derived from 
two sources: 

1. The Agency Questionnaire was designed to elicit agency reactions to and perceptions of the 
RDP in the following areas: . xx • ^ 

How they first learned- about the program. This was used to assess effectiveness of 
outreach methods. 

Kinds of involveinent. Thirteen categories were offered, to-be checked and ranked in 
the order of frequency. ' . . 

Knowledge of RDP program. This was assessed through a Likert-type scale similar to 
^ the Parent and Staff questionnaires. 
Satisfaction scale. 

Perceptions of the quality of the RDP program as an intervention alternative for 
handicapped children. 

Open-ended questions about the major constraints and benefits of the collaborative 
relationship arjd suggestions for improving collaboration. 

2. Interagency Collaboration Logs recorded all contacts with other agencies and were 
reviewed to determine the type of agencies with which contact was established as well as the 
duration of collaboration. The records involved 91 different agencies, including nursery and 
elementary schools^ social service agencies, and medical centers (including hospitals artd 
physicians). Records were maintained by the project director and appropriate project staff. 



Analyzing and Using the Data 

Descriptive statistics, including frequency counts, percentages and means were computed 
for appropriate variables. The findings Suggested that the program was successful in 
establishing contacts with all types of agencies, especially for the purposes of referral and case 
management. Agencies considered the program an excellent source of referrals for young 
handicapped children and were satisfied with their interactions with staff. However, they did 
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report a low level of understariding of the pj:ogram's operatidn and philosophy, despite the 
number of years they had been involved with staff. Based on this information, a goal was set to 
increase agency knowledge about the program Jthe following year. A day of prdgram orientation 
for these agencies was planned and implemented. 

Implementation * 

This evaluation was not planned until the third year of the prograjp. Since the program was 
consulting to others in the area of interagency coordination and had, ir fact,' developed a book 
on this subject, A Guide for Creating Conrtmunity Awareness and Incera<jency Collaboration , 
(Eagen, >)one8, Petisi, & Toole, 1981), it was essential to demonstrate the* program's 
effectiveness in this area. ' , > 

The results of this evaluation were for staff use. They could choosB to change the way 
collaboration efforts are conducted, but ^the positive na«ture of the^ results indicate that no 
major changes are presently needed. \ , 

REPORTING EVALUATION FINDINGS 

Audiences 

* ,•• 

Several groups of people will be interested in evaluation findings.. Staff member^ wish to 
know the results of their effort? and how to make those efforts more effective, and parents 
want to know haw their children have improved. Local education agencies will want to know if 
children from their districts are improving and which children will be inr need of special 
education at school age. They also are interested in the cost benefits of such a program, since 
their community eventually may support the undertaking with local tax dollars. Other early^ 
childhood specialists from regular .and special education have often requested that the RDP 
share information with their community and boards, and they have frequently asked for help in 
preparing an evaluation plan which is practical and can be accomplished irf their setting. Town 
or county leaders are also prime candidates for the information. The more they are made 
aware of what the program accomplishes, the more likely they will be to lend support in time of 
need. And programs need to look increasingly to their own areas for support as federal aid 
diminishes. 

The RD|? also provided evaluation information to newspaper reporters, the school board, 
colleges and universities and loclaMegislators. They were reached through awareness mailings, 
an institute, and the dissemination of 'proceedings of that institute. 

Finally, but certainly not least important, the JDRP was an audience. Unanimous approval 
of the program's effectiveness from that body suggests the soundness of the evaluation.! 

Format and Means of Delivery - 

Evaluation findings can be disseminapfed in marty forms— from short presentations to 
complete reports. The following list describes formats used by the RDP: 

1. Oral Presentation - of evaluation design, its- rationale, the results and their 
implications. Useful at staff and parent meetings. 

2. Summary Sheet - of results, clearly'listed. Useful in staff and parent meetings and as 
material mailed to parents with a cdver letter. 

3. Overheads - of design (outline), of data analysis, charts, of lists of outcomes and 
long-term effects. Useful at various staff, professional ^nd community meetings. 
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4. Fact Sheet - describing program components and* evidence of effectiveness (one 
page); Should include: expert testimony, information on grants awarded, summary of 
third party evaluation results, pre and posttest information, placerripnt i^ecord, 
long-term 'effects, parent reactions, community reactions and statement about 
national validation. Useful in visitor orientation packets and at meetings with 
community members, reporters and legislators. 

5. Slide Show - df program. Should include: summary charts of evaluation results, 
placements and long-term effects. Useful for professional presentations and at 

institutes. r , \ 

6. Evaluation Reports - of the project's work. Should include: background (history), 
description of program, focus 'of evaluation, theoretical framework,, methodology, 
resCjlts, dispussion, recommendations and references. Useful for program staff, 
funding sources an'd Boards of Education. 

7. Executive Summary - of evaluation report. Should include concise statement of 
> program description^ evaluation methodology, major findings, recommendations, and 

conclusions. Useful for professionals and community. 

8. Abstracts - of one them^ of the evaluation^ Useful within the community and with 
professionals. « 

9. Position Statements - on education of the handicapped. Should include statement of 
position supported by evaluation results and cost study descriptions! Useful at public 
hearings and with state, local, and federal officials. - 

10. JDRP Submission - regarding eyaluation. Should be: a 10-page document outlining 
program services, unique features, theoretical frameworlfT^vidence of effectiveness, 
and cost to replicate project. Usef al for JDRP Panel and a variety of audiences. 

The RDP"also prepafed a proceedings of an institilte on efficacy, which included the 
Ifetional perspective on the subject, a statewide perspective, evaluation (immediate and 
long-term)' effects and recommendations. It has been useful for county executives, state 
legislators, State Education Department officials, directors of special education, advisory 
council, the United States Department of Education and many special education progranrw. 

» 

• Figure 2 suggests methods and formats for reporting to different audiences. 

PREPARING FOR JDRP: A PLAN 

The procedure of preparing for JDRP validation can be considered to be a three-step 
process: o 

1. A schedule showing the program evaluation over three years must be prepared. This 
must be an integral part of the project's work during the first three years. 

2. A written statement of the evaluation must be created. It must be done in a 
relatively short time and yet convincingly make a case for the program's 
effectiveness. (The RDP staff finally submitted it^ fourth draft to the Panel.) The 
most difficult part of writing the submission was describing the program model in a 
clear and concise way and analyzing the data in as many ways as possible in order to 
rule out rival hypotheses. While the paper had to describci the, tota| program and its 
results, it was important not to confuse the reader. Infornjation deemed to be 
extraneous was not included, yet was brought to the panel meetings in case further 
clarification of any particular point was requested. 
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FIGURE 2 ' ' 

Reporting Evaluation Findir«gt to Oiffaront Audiencnt 

\ 

PERSON(S) < . 
MEANS OF DtLIVERY RESPONSIBLE Tl|MES ^ FORMATS 

Staff Meetina Administrator or [ Periodically through the Oral Pretcntatibn 

. S ' ^ Evaljuator year , Summary Sheet 

J Overhead 

A H — 

F ' 

F Individual Conference E valuator After the implementation Dittuasion 

•tudy , 

— Parent Meeting Administrator Beginning of Year Oi;al Pretentatlon 

p , . ; .--.^ - 

A - ' . - 

R Parent Orientation Settlon Coordinator of Program Entry into the Prpgram Fact Sheet 

E — ^ ^ ' 

N 

T Letter to ParenU Adminittrator End of Evaluation Period Summary of RetulU 

S 

Visitor Orientation Coordinator of Program Periodically through the Fact Shaet T 

p year Summary Sheet 

R " 

0 .tjfii; 

F Profettional Conference pre- Adminittrator and Evalu- Slide Show 

E sefnationi "tor Ovarhwidi 

S In-Aqency Meeting* for School . ' Summwy Sheet 

S District Personnel Periodically through the Complete Evaluation RaporU 

1 Meeting! with State and Adminittrator year • Executive Summariet 
O National Agencies AbatracU 

N Contuitationt for Evaiuatkin ^ . Inttitute Procaedingt 

A Journait , ' 

L Contortium Meet'ingt r'- 
S , State and Local Mailings 

Public Hearing Adminittrator When Appropriate Position Statement 

Board Pretentation Adminittrator and Evaiu- Slide Show' 

Advitory Council Meeting ator Overheads 

College and University Uatt Administrator When Appropriate Summary ShaeU 

C Presentation ^ o Abstracts 

0 Regionai^ursery School Administrator or Coor- 
M Workshop dinator of Program 

M ; • — ; T 

N Institutes for Legislators ' Administrator or Evaiu- End of Evaluation Period Institute Proceedings Paper 

1 individual Meetings with ator and Other Times as Ap- 
T Reporters t proprlate , 

Y ; 

Community Oispiays Coordinator of Program When Appropriate Summary Sheets 

J Panel Administrator and Evaiu- After Submission Process Required Submission 

Q ator* Summary Charts of Data 

^ I Evaluation Reports 

p - ... 
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' V3. The actual meeting with the panel must be planned for. This required a great amouQt 
of time. A study guide was prepjared which' listed numerous questions which might be 
^ked by the panel. These were gathered from* panel siirtulations, attendance at an' 
• actual panel, books^ written regarding evaluation and the JDRP- handbook. J3^ttending 
the panel presentation helped In getting a feel for the room, the tone ot the meetings 
and the strengths ami weaknesses of submitters.' Role ^playing a panel presentation^ 
with local evaluators, administrators and psychologists helped raise questions for 
which answers were'^ prepared. It also helped the presenters prapt'ice answering , 
clearly anrf. concisely. Charts were developed which summarized data not in, the 
submission so that the evaluators could easily find an answer to a question and not 
have to respond: "The data is not available." ThV type of response could easily hav* 
had a negative effect upon the approval. Finally, it was important to decide' which 
"^rson— the administrator or evaluatop^purwould answer which questions.- This 
technique helped the presenters provide answers .quickly and erfficiently during the 
panel meeting. 

Figure 3 sums up the activities necessary to prepare for JDRP review. ^ , 

. ^ SUMMARY AND CONCLUStONS 

The benefits of the RDP's evaluation efforts are clear. The informdftion gained has helped 
strengthen tPie {urogram and attract increlased support. Furthermore, it was both important «3d 
very satisfying to see that the results of the evaluation, were positive. No major weaknesses 
were identified in the program. Th^ assessed effects on children, both long- and shoft-term, 

were positive. • . l. i 

In retrospect, the* only major change that should have been made in this^evaluation process 
would have been .to hire the evaluation consultants from the first year. This would have 
provided a more focused approach during that period and would have prevented 
backtracking-the elimination of instruments and methods in the second year. 

The RDP has established a firm commitment to evaluation.^ There have been numerous 
occasioas to share evaluation results, and all have been positive-building support from various 
audiences both for this program and for the importaope.of serving the young handicapped child. 



18 



s 



: FIGURE'3 J 

The DDRP Process 
/Preparing a Three-Year Timeline ' . ' * 

Begin gathering as much data as possible in first year 
Seek outside evaluators if necessary 

Hire evaluatoib sensitive to evaluating handicapped ^ . • 

Hire evaluators sensitive to classroom routine and teacher's feelings 
Use normed instruments if possible 

Use outside testers \ 
1 Use many sources to evaluate a claim af effectiveness 

Rule out children who are involved in other forms of intervention * 
Spend time monitoring and talking with evaluators 

Revise data collection in Year Two, based on results of Year One ts^ 
Eliminate unnecessary data collection - 
Add additional form of xJata which might now seem appropriate 
Keep data collection techniques constant if results are positive 

Preparing the Submission 

Begin preparation immediately after completion of Year One 
Utilize past JDRP-approved submissions as examples of writing styles 
Describe a sound theoretical base 
Describe unique features clearly ♦ 

Be certain that your claim of effectiveness fits the data presented . . 

Attempt to rule out as many rival hypotheses as possible 
Include as much information as possible in the submission 
Make clear, precise statements which do not raise questions 
Use a case study as a sample 

Preparing for Meeting the Panel 

Start in the beginning of Year Three 
• Prepare a study guide of questions which may be asked 
Decide who will present to panel 

Decide who is responsible for answering what questions 
Research answers to each question 

Practice answering questions and decide on appropriate and agreed-upon answers t( 

questions ^ x v/ tu 

Gather various backup data (information on replication sites, results ot Year inree 

information on graduates) 

Analyze data for generalizability (whether program worked as well across ages 
sexes, handicapping conditions, socio-economic.levels and type of community) 
Role play a panel presentation 
Attend a panel presentation ^ 

Set up a helpful panel who will raise questions and discuss possible answers 
Bring all data to the presentation in simple, easy-to-refer-to chart form 
Be prepared to describe a case with results if asked 
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APPENDIX 1 

Sample Draft Evaluation Plan 
(from Classroom Program) 



Eval. Question 



Eval. Task 



Criteria 



Source Responsibility 



Did the chil- 
dren in the 
classroom pro- 
gram exhibit 
growth in tar- 
geted areas of 
.delayed devel- 
opment? 



Pbtain infor- 
mation on the 
status of 
children in 
the program 
in the fall 
and spring . 



•05 signifi- 
cance level 
positive 
grov^th in all 
.primary tar- 
geted afeas 



Alpern/Boll 
(October and 
May) 



Clinical Team 



McCarthy (Oc- 
lober and Mpy) 



Outside Jester 
Psychologist 



Teacher obser- 
vation (Octor 
ber, January, 
May) throujgh • 
anecdotal 
record in pri-^ 
mary target 
ar^as*^ 



Teacher 



Parent obser- 
vation (Octo- 
ber and May 
Question- 
naires) regar- 
ding primary 
target area 



ParSnt 



Videotape 



Coordinator 



i 
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APPENDIX 2 



Draft Evaluative Questions 



GoaAd) 

" To develop and d^monitrate a 
clataroom program and home 
training orogram to meat the 
needs ot^reachool handl* 
capped children. 



Que«tion(i) 

1*, What are the key elements of the innovation? 
2* How arts they uaed? 
3f« bo team members understand them? 
4« Do team members* philosophies match 
innovation? 



Audience(s) to 
Receive Results 

Educators 
Legislators 
Community Agenciea 
Joint Oisaemination 
Review Panel (X)RP) 



To evaluate each child's 
4jSvalopmental level and to 
demonstrate that studenU 
participating in the ROP 
achieved significant gains* 



3. To increase the effectWenes 
of parents in facilitating 
the development of their 
handicapped child* , 



U Did the children improve in areas of cognitlon» 
motor, social, and language development? 

2. Were their gains significant compared to the 
norm group? > 

3* What percentages of education objectives were 
mastered? 



Parents 
Cduciliors 
Legislators 
Community Agencie 
JDRP 



U How many parents received services? 

2* What were the services? 

3. What was the level of receptivity and satis* 
faction of parents in regard to their involve* 
ment, their understanding of the program 
and iU resulU with their child? 



Parents 

Educators 
Legislators 

Community Agencies 



To select or adopt curricu- 
lar materials to form the 
basis of the instructional 
program and to redesign the 
program baaed on the effects 
it has on graduates. 



1* Were materials identified? 

2. Do teachers perceive the material to be 
appropriate for the population? 

3. ' Were the gains made by the children maintained 

over time? 

4< What are the longitudinal effects of the 
program with regard to placement, reten- 
tion, special services and teach«r rating, 
parent ratings, and persistence of effect? 



Parents 

Educators 

Ldgislatort 

Comnujnity Agencies 
JDRP 



5« To develop and demonstrate a 
service delivery model that 
could be observed* 



1. What demonstration activities were conducted? 

2. What agencies requested or received services? 
>• How often were services requested? 

4* What follow-up activities were performed? 
5. Was the information provided useful tb thtf 
audiences? 



Parents 
Educators 
Legislators 
Community Agencies 



6* To develop and demonstrate 
support services for area 
preschpols, nursery schools, 
and day care centers for 
integrating handicapped 
children into the program. 



7* To provide ponsultation and 
assistance to. other inter- 
mediate units and local 
school systems. 



1. Were egency reactions to and perceptions of the 
RDP positive? 



Commy^ty Agencies 



1. Were agency reactions to and perceptions of the 
RDP positive? 



Educators 
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8* To Mtkt teiect«d school 

tytterm in New York State to 
implement the model end 
evaluate its «ffactivenew? 



2. 
3. 
4. 



6. 



B. 
9. 
10. 



11. 



\ 

Que^tionCs) 

What are they key eietnenta of the innovation? 

How are l;iey used? 

Do team members understand them? 

Do team members* philosophies match the 

innovation? 

Did the children improve in areas of cogni- 
tiont motor* sociai, and language development? 
Were their gains significant compared to the 

norm group? 

What percentage of education objectives were 
mastered? 

How many parents received services? 
What were the tervices? 
What was the level of receptivity and satisfac- 
tion of parents in regard to their involvamentf 
their understanding of the program and its 
results with their child? 

W^re agency reactions to and perceptions of the 
RDP^positive? 



Audience(s) to 
Receive Results 

Educators^ 

JORP 



9. To demonstrate that preschool 
education is necessary and 
should be mandated. 



2. 

5. 
6. 



7. 
8. 

9. 

10. 



Dicfthe children improve in areas of cognition* 
motor, sociaii and language development. 
Were their gains significant cortipared to the 

norm group? 

What percentage of education objectives were 
mastered? 

' How many parents received services? 
Whtat were the services? 
What was the level of receptivity and satis- 
faction of parents in rgard to their invoivementt 
their understanding of the program and its 
results with thpir child? ^ 
Were materials identified? 
Do teachers perceive *the material to be appro- 
priate for the population? * 
Were the gains made by the children maintained 
over time? 

What are the longitudinal effects of the program 
with regard to placement^ retentiont special 
services, and teacher ratingsy parent ratings, 
and persistence of effect? 



Legislators 

Community 



ID. To obtain alternative 

funding for continuation of 
services at conclusion .pf 
demonstration funding. 



1^: A,, 



1. Was alternative funding obtained? 

2. Was effectiveness data available to help obtain 
this funding? 

3. Did the children improve in areas of cognition, 
motor, social, and language development? 

4f Were their gains significant compared to the 
norm gtoup? 

3. What percentage of education objectives were 
mastered? 

6. Were materials identified? 

7. Do teachers perceive the material to be appro* 
priate for the population? 

8. Were the gains made by the childl^en maintained 
over time? 

9» What are the longitudinal effects of the program 
""U' t regard to piacement,^ratention, special 
services, and teacher rating, parent ratingst 
and persistance of effect? 



Community 
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Northwest Center Infant and Toddler Program 
Project Evaluation Plan 
for Integrating Normally Developing and Children with 
Handicapping Conditions into One Program 

Linda L. Gil 



Evaluation has been an integral and important component of the Northwest Infant/Toddler 
Program since the first year of funding* Work on the evaluation plan presented here was b^gun 
during the program's first six months^/and since that time, the plan has proven invaluable. In 
addition to meeting its original goals— those of directing efforts to assess the effectiveness of 
the model and to convey this information to others— it has also served as a guide to overall 
program implementation. By conceptualizing the entire 36 months of the project, the 
evaluation plan clarifies the events that need to occur, UAsir place on the project's timeline and 
how they contribute to accomplishing program goals. All in all, the proc9SS of developing and 
using this plan ha^been an extremely positive one for the program. 

This chapter Includes a copy of that plan and a brief account of its development, as well as 
an introduction to the program and recommendations for use of this evaluation format. 

The Northwest Center Infant/Toddler Program: A Description ^ 

The Northwest Center Infant/Toddler Development Program is an HCEEP demonstration 
project serving equal numbers of handicapped and nonhandicapped children from birth to 36 
months. It includes a full day, in-center program, featuring developmentally integrated small 
groups, individual development plans. fpr^ all children, and opportunities to balance normal and 
atypical growth and development. Home-based -and_ combination home and center-based 
programming are also available. Parent programs include monthiy.. evening parent meetings, 
classroom activities, parenting, skills development sessions, single parent counseling groups and 
individualized programs for developmentally disabled parents* Cooperative contracts with 
colleges and universities provide a practicum site for teacher, nursing and nutrition interns and 
volunteers. 

Developing the Plan 

The Infant/Toddler Program was accepted for HCEEP funding in 1980. During the first Six 
months of operation, the Project Director met several times with the WESTAR (Western States 
Technical Assistance Resource) technical assistance coordinator (TAC). Work on the evaluation 
plan was begun at these meetings. 

The TAC. strongly recommended an approach that was based on the identification of key 
program elements. These were not the project's goals and objectives, as defined in the original 
~ proposal, but rather the significant components to be developed through the achievement of 
those goals» The seven elements identified were systematic inclusion of nonhandicapped 
children into existing early intervention programs, assessment procedures and curricula 
^ ^ adoption for nonhandicapped and handicapped populations, parent involvement, staff 
development, coordination with existing community programs, the child care aid^ curriculum 
and child nutrition. These seven elements became the conceptual focus of the plan. 
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With the elements as a guide, the purpose of the evaluation and the needs of potential 
audidnces were identified (Table l)^s were the key evaluation questions to be answered (Table 
2). For each of the questions, the plan spells out the methods of evaluation, the procedures for 
collecting and analyzing data and the evaluation, criteria involved (Tables 3-9). 

Designing a Format 

The next step was designing a format to display the plan. The particular format developed 
by the Northwest Center Infant/Toddler Program followed research into what other people had 
written and was determined by several factors. 

- the need to conceptualize the entire 36 months of the project as events on a 
continuum, with goals and objectives to be accomplished; changes occurring in 
parents, children,, staff; and some specific questions to be answered regarding 
pregraiji elements. • ^ 

the attempt to answer the questions that many different audiences would be asking, 
the attempt to design a format that could be used by other projects. 

j» 

The format begins with a listing of the elements and their sub-elements and then gives, for 
each one, a rationale (why is this important?), the objective to be achieved, the activities 
leading to that objective and the means of evaluating its achievement. There are two cover 
sheets. One explains the goal of the evaluation (Table 1). The other outlines the overall 
evaluation plan (Table 2). In addition, there is a summary of the evaluation implementation 
plan, which lists the personnel, times, and monitoring activities for each program element 

(Table 10)^ Project Director's intent that this evaluation design could be adapted for use by 
other projects. The format would remain the same, but the 'questions asked would be program 
specific. The design has so far been used by two other projects. They have found the format 
adaptable to their needs and have found the overall questions and categories described in Tables 
1 and 2 to be relevant and useful. 

Recommendations 

Based on the experience of the Northwest Center Infant/Toddler Program, the strongest 
recommendation regarding this evaluation design. is that it should be completed within the first 
3 to 6 months of operation. It is suggested that whenever possible, a similar design be included 
in the initial proposal. It becomes clear as a program is carried out that questiohs such as those 
posed here should have been asked at the beginning. Experience has shown that the 
evaluation-the methods used to determine program effectiveness-is just as Important a 
component of the program as services to families. 

The tables that follow represent the Northwest Center Infant/Toddler Program's complete 
evaluation plan. Either individual tables or the overall format may be adapted to fit specific 
project needs. Although, as mentioned, thisf is best done at the program's inception, the tables 
may also be useful in suggesting improvements in evaluation. components of already functioning 
programs. 



NORTHWEST CENTER INFANT AND TCXXX^ PROGRAM 



Project Evaluation Plan for Inugrating 
Normally Devaloping and Childran with Handicappihg Condltiona ^ 
Into Ona Program 

Goal of Program Evaluation 

Tabla I '^/^^ 

Evaluation Focus: To show that handicapped and nonhandicapped children and their parents can benefit from a full-day childcara setting that meats their naedi of compre* 
hensive services at one site. 



ON 



^ Purpose 

This evaluation is being 
conducted to meet funding 
requirements, to monitor and 
administer the project, 
to strengthen information 
to be made available for 
dissemination and to document 
the need for elements of 
such a program to be repli- 
cated in the community. 



' Audience 

Project Staffy funding 
agencies, community 
agencies, local school 
districts, other profes- 
sionals and researchers. 



Audience Information Needs 
« 

Audiences need to i<now how 
children progressed; that 
normally developing children 
did not regress but progressed 
and were acquainted with 
other's needs; that handicapped 
children received services 
in a most normal environmenti 
adapted to their needs; that 
parents can be involved in 
their child^ full day programi 
that attitudes and myths 
concerning education of 
handicapped young childrerv 
were dispelled; thet theirs 
is a need for community full- 
day care» including compre- 
hensive services delivered 
on one site. 



Key Program Connponents 

Individual progranis 
for each child. 

SmMl davalopmentally 
Integrated groups. 

Parent Involvement of 
both populations. 

Staff davalopmanL 

Coordination -with exist- 
ing community programs. 

Devalopnnfnt of parenting 
sIcUls. Curriculur^ for 
hoentally handicapped 
parents. 

Child<«are aid training 
and curriculum. 



Statement of Intent 

It la the purpoee of this 
availuatlon to tdtontlfy key 
elements of this project 
and to document thtf ir 
implementation end progress; 
to provide aubaeque h t 
' Ihformetlon to target 
eudiences end to eaalat in 
repllcetlon eotlvltiee. 



- Child nutrition. 



Delivery of comprehensive 
services (including ' 
therapy and educational 
component) In e completely 
integrated full-day 
chUd care setting. 



Linde L. GU» Project Director 

Project Steffi Teachers - Kriste Eberle-Stitzel; Angela Zimmer; Sandra McCuUoch; Sarah Mulligan; Karria Murphy; Don Bingham; Roger Page; Karen Sue Wend; 
Mirlem Rabitz; Diana Cemell; Tory Cleric; Leislie Keller. Thar{pists - Ann Nelson, CDS; Claudia Andrews, CDS^ ISuzanne Larson, OT; Jean Myera, PT. 
Cook/Nutritionist - Stephene Beetty end Nency Allen; Home Specialists - Doreen McKenne and Liz Mercer; Nurse - Wendy Brulngton; 
Clessroom eMes • Charlene Ihompson; Teresa Bartosik; Barbara Leen; Glorle Barnes; Ell^ w ' 




NORTHWEST CENTER INFANT AND TODDLER PROGRAM 

Overall Evaluation Plan 
Tabla 2 



Evaluation Questions 



Evaluation Methods 



Data Collection Producures 



Data Analysis 



Evaluation Criteria 



U Do handicapped children 
continue to acquire skills 
while participating in a 
^ totally integrated or 

mainstresmed program? 



2. Do normally developing 
children continue to 
acquire skills at an ex- 
pected rate and to progress 
while experiencing integra- 
tion witb handicapped 
children? 

3. Are parents better able to 
adjust tc their handicapped 
child with^their needs for 
full day care and therapy 
serviqe^ met? 

4. Do both sets of parents 
communicate with one 
another at parent meetings 
and in informal parent 
involvement activities? 

What are the Identified 
needs, preparatloOf train- 
. . ing and characteristics of 
staff working in this 
model? 



U Initial assessments, lEP 
written classroom narra- 
tives, CDS, PT/OT, 
quarterly reports. Pre/ 
post assessments* Cumu- 
lative, formative and 
summative reports. 



2. Initial aasessmenls, pro- 
gram plan, ongoing moni- 
toring, quarterly narra- 
tives. Pre/post assess- 
ments* 

3* Survey of parent attitudes, 
participation and satisfac- 
tion yielding cumulative 
and summative information* 

4. Documentation of informal 
observations* at meetings 
and reporta on advisory 
convnittee. 

3* Needs asseaanrientf utiliza- 
tion of existing criteria, 
intarvice training 
required, ongoing staff de^ 
velopment and identified 
skills and competencies for 
staff of integrated/main- 
streamed population! 



I. InstrumenU t» be used: 
Standardized 
Bayley Scalea of Infant 
Bevalopmentt Caldwell 
Inventory, Miller , 
Assessment for Pre- 
schoolers, Sequenced 
Inventory of Communi- 
cation Development 

2* Selected criterion re- 
enced instruments* 

3* Parent Behavior Progres- 
sion for thoae parents 
whose initial assessment 
reveals it an appropri- 
ate protocol. Criteria 
referenced aaseasment 
tools. Staff developed 
parent satisfaction 
forrm, staff satisfac- 
tion forms, par^tioipa- 
tion forms, diary folder 
of advisory committee's 
activities, t$^umenta- 
tlpn of inaervice train- 
ing offered to sUf f, 
the Skills Igvy to'V 
Teachers (SFT), and 
their individual deveU 
opment plena. 

4. Pre-post teaU of Cald- 
well Home Inventory en- 
nuelly; 

5* Semi-annual re-eveluetion 
With SFT, individual de- 
velopment plan and documented , 
acquisition of those ikllls , 
end competencies identified 
ea eaaentiel for a main- 
streamed end integrated program. 



I , Comparison scores on 
*Bayley Scele of Infent 
Development every 6 
months for each group 
of 16 children, over a 
a period of 2 years. 
Bayley scores, Miller 
scores, child chenge daU 

2* Study of play behaviors 
^ and social interaction 
between normelly devel- 
oping end handicapped 
. children conducted by 
graduate end doctoral 
students from University 
of Washington. ^ 
Summary scores of parent 
participation in parent 
activities. 
3-4 Summary scores ol parent 
participation in parent 
activities. 



I . Predicted rate of move- 
ment on the Beyley Scele ^ 
for, both normally developing 
end handiceiiped children 
indicates compatibility with 
program dealgn. 



2-4 Individual program goals 
that reach. 00% criterion 
end reflect generellzatlon 
of acquired akllla for 
parenU in home beaed pro- 
gram. Comparison scores of 
pre-poat Celd«^ll Home In- 
ventory program (entry end 
9 months lalsr) itxt both 
normelly developing child- 
dren^ perenU end perenU 
of a child with a handicap- 
ping condition. 

3. SIFT checklist, criterion , 
80% of skUls acquired 
* within six mqpths of employ- 
ment. Reevakiatlon every 
six months. Self check end 
crdas';checklng with program 
director. 
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Etonrwnt Evaluation Onai Systematic Inclialon of Nonhandcappad ChUdran 



PROGRAM 
ELEMENT ONE 



KATIONALC 



OBJECTIVES 



ACTIVITIES 



EVALUATON 



1.0 Syttemitic Inclusion of 
Nonhandicapped Children 
Into Existing Early Inter- 
vention Progroms 



oc 



1. A set of ^oceduret and 
guidelines needs to be 
devel^H>od to establish 
the most appropriate methods 

; of integrating normally 
developing children into 
an existing early inter- 
vention program, because 
it IS the least restric- 
'tive and'most normal en- 
vironment to a child who 
.is atypical in ^velop- 
merit. It provides a 
socialization experience 
for normally developing 
children and a needed 
full day care experience « 
for working parents of 
both populations* Program 
is compatible with philo- 
sophy that a child is 
perceived as a whole, ^ 

' with handicapping condi- 
tion but one aspect of 
the developing child. 



1. Given the need to identify 
and focus on those compo- 
. nentSy the project will 
establish a systematic pro- 
cess and ' 

Will define those components 
and convert them to program 
activities. 



Individual Davaiopmant 
Plan (DP), baaed upon 
aasaasnnantSy for each 

normally developing 
child. 

Ongoing daily partici- 
pation in a davalop- 
mantalfy intagrated 

group. 

, Formal axpariancaa in a 
pear ^roup arrangan>ant 

'(children at same stage 
of development). 
Informal observation 
and recording of play 
skills. 



ChWiqa maaaurad by DP and 
lEP (Individual EducaUonal 
Plan of handlcappad childk 
Baylay Scales of Mwk 
Development agminiilaffad et 
6-monm kitervala during 
esOT chlfd*ii participation 
In the progremi^eaoh chiltfs 
acorea of Mlvldual cri« 
terlon-referonoad taatst . 
edminlatered three times 
yearly^ as recorded In pro* 
gram Setlsfectlon measured 
by parent end teecher aotis- 
fectlon fdrma completed et 
the three scheduled confer- 
ence aaiifona. 
Change dete la expected to 
show ix> da cr >eie on Beyiey 
Scales for the ndrmelly de- 
veloplng children es e 
result of Integrated set- 
ting» rether e maintenance 

*^eval or acceloTeted changer 
criterion-referenced tools 

. will be expected to show ,^ 
skills galped In eccordence 
with normal devetopmentel 
schedules. 



LI Sub Element 
lOP ProcoM 



There is^a need for pro- 
cedures in the develop- 
ment of a^nonhandicapped 
childls program that is 
leas structured than tra- 
ditional approach for 
handicapped child* Tra- 
ditional full dey care 
does fkit usually provide 
parents* with an ongoing 
apprisal of childPs dally 
activities through an 
overall program plan that 
is nKxiitoTad and periodi- 
calfy re-ay alueted. The 
inoepth lEP/process is 
specific to the child with 
' handicapping conditions. 



Given the need to implement 
simple assessment and indi- 
vidual program plan proce- 
durest format and forms will 
be developed» establishing 
a process for .meeting child 
and project staff needs. 
Provide perents with written 
information relevant to 
child^ progress. 



Establish procedures 
Define process 
Select format 
Select assessment pro- 
tocol 

Select curricula 
Define evaluation pro- 



Cstebiish file proce- 
dures. 

Monitor child progress 
Provide written ciess- 
room narratives 
Elicit parent partici- 
pation through parent 
conferencing 



Recorded parent end steff 
setlsfectlon forms eveluated. 
Acquisition of skills by 
children In lOP. 
Change detac Documented 
skill ecquisltion In eccor- 
dence with norm^ develop- 
mental acheduleSf consistent 
with chlM etiological 
ega. 

Written reporting will occur 
every 4 months efter Initial 
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PROGRAM 
ELEMENT ONE 



RATIONALE 



Tabie 3(qonUfMi«d} 



OBJECTIVES 



ACTIVITES: 



EVALUATION 



1.2 Developnnrentally into-* 
grated imal) groups 



1,3 Informal observation, 
play skills 



Staff and children can bene- 
fit from peer modeling beha- 
vior. Reduced cao^petition 
for adult caregiver atten- 
^tion benefits chtl^ small 
groups desirable In birth to 
three population; make ap- 
propriate use of all equip- 
ment and opportunities for 
social/emotional growth. 



Emotionafy physical and'psy- 
chplogical development 
through play (s the focus of 
the birth to three popula- 
tion. We need to know If ' 
children play more ap*propri- 
ately as a result of this 
program design. 



Given the need to determine 
appropriate group size and 
ratio of nonhahdi capped to 
to handicapped, project staff 
will collect Information (hat 
will validate developmenlally 
integrated groupings as a 
preferred model for grouping 
children In a full day set- 
ting serving nornially devel- 
oping and childrefri with han- 
dicapping conditions. 



Given the need for observing and 
recording play skills In the 
child's envlronmenti the obser- 
vationa will yield information 
concerning approprlatonaas Qf 
asaociative, parallel or coop- 
erative play of the npohandl- 
capped and handlcappad In this 
setting. 



Establish a set of cri- 
teria that evaluates 
the devalopmentally In- 
tegrated groups* ^ 
Define method of ob- % 
serving child changes 
In devalopmantally in- 
tegrated group. < 



Changae 



Identify and select 
play akllls checklist, * 
Adapt for learning an- f 
vironmant. 

Determine hbw It wiM . 
be usedi evaluation 
tystem. 



_ documented movement 
* and CP for MCh 
child in devalopmantally 
Integrated group. Quarterly 
written daaaroom wrativo. 
Satiafoctionc pavantand 
staff faadback forma.c 
Change data^ WUl be expect- 
ted to show if factivanaat of 
developfiiantaUy Intagrated 
groups fdr norMndlcapped and 
and handicappad children. 
Subjective ahd ojbjactive ex- 
ternal recording of obaarva- 
tlons. 

Re«islta of study of Play Be- 
(i.e« Smilanaky, Parton andy 
or O^om Scale) conduotad by 
graduate atudenb from 
Uniyerelty of Waahingtoov 
under auparvition of Or. 
Rebecca FawalL 



Tablt 3A 



Evftluation of Sub Elemant 

SUB ELEMENT I. i ^ 
INDIVIDUAL DEVELOPMENT 

PLAN (IDP) NORMAL CHILD CHILD PARENT ^l«™,oAx,r^K. 

. PARTICIPATION PARTICIPATION 

INDIVIDUAL EDUCATIONAL PLAN 
(lEP) HANDICAPPED CHILD 



Documentation 



IDP apptm in appropriate 
chiid*t file. 

lEP appears in appropriate 
child% file. 



Notification of parent confer- 
ence appears in each chilcfs 
f ile, parent signature on cover 
page. 

Procedures consistent with lEP 
process. ^ 



Staff responsible for follow- 
ing procedures established 
for IDP signatures on initial 
assessment and cover form. 

lEP implementation^ monitor- 
ing, data collection, evalu- 
ation, update conference. 



Satisfaction ^ Completed form will be filed in Completed form on file In 

each child's file after each each child^ file, 

conference 



Will be formuiatad by 
chlld^ accomplishment of 
85% of tMics accomplished 
in 4-month period. 

F or^handicapped child, ac- 
quisition of 85% of program 
goals in annual lEP. 



Will be formulated from docu- 
mentation of satisfaction 
forms. 

Conferences 

Written documentation 

Satisfaction forms 



Will compile satisfaction 
forms and file then in 
chlld^ file. 

Staff will evaluate useful- 
ness of Identified ourricula 
for the normally developing 
child. 



?U6 £L£M£Nt Li 

DEVELOPMENTALLY 

INTEGRATED, 

PRIMARY GROUPS 

rOR NORMALLY DEVELOPING . 

AND HANDICAPPED CHILD 0 



Documentation 



Initial classroom assignment 
to group represented by, in- 
fant, toddler, preschool 
composition. Eight children 
maximum. 



Parent notified in written form 
by mail, and verbally at time 
of developmental interview. 



Informed verbally as to 
placement by Home Specialist 
and is aware of parent noti* 
fication in child's file. 

Conference with parents. 
When possible, Inltli^ home 
visitation by teacher. • 



Satisfaction N/A Satisfaction sheet administered Feedback form administered in 

at parent conference time to. June of each project year, 
provide feedbacl< concerning the 
developmentally integrated 
groups. > « 



Change Data Skill acquisition on the IDP 

and lEP consistent with pro* 
jections.^ 



Generated through evaluation of 
data 'concluded from satisfac- 
tion forms entitled "Annual 
Program Satisfaction" and 
Tinal Program Satisfaction" 
form* 



Generated through data con- 
cluded from staff satisfac- 
tion forms and, if neceeeery* 
program changes. 
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PROGRAM 
ELEMeNT TWO 



RATIONALE 



2.0 Atseatment Procedures 
and Curricula Adoption 
for Nonhandicapped and 
Handicapped Popuiatiorfi 



2.1 Sub Element; Aatestment 
Procedures and Curricula 
used for handicapped pop- 
ulation (individual child) 



There needs to be a systema- 
tic process for structuring 
the learning environmant to 
facilitate progress and pro- 
mote learning through the 
4 program. 



Need for identification of 
specific asaeasment instru- 
ments and consequent use for 
program planning and docu- 
menting progress of indivi- 
dual child. 



2.2 Sub Element* 

Curricula used for non- 
handicapped population 
(individual child) 



Need for identification of 
specific means of assessment 
arSd conaequent' use of curri- 
cula for documenting progress 
of individual child. 



ERIC 



Tabled 



OBJECTIVES 



Given th6 need to determine which 
curricula are comprehensive 
and answer ihe moat fwedsi the 
project identifies them m neces- 
3ary for program growth. Define 
what is included in a curriculum. 



Given the need for aaaeasment of 
each child and a sequenced cur- 
riculum! project will deter- 
mine what curricula are moat ap^ 
propriate for documenting child 
change and movement. 



Given the need for individual 
assessment and a sequenced 
curriculum(a)| this element will 
determine what curricula are 
appropriate for documenting child 
change through systematic and 
and sequential program planning. 



ACTIVITIES 



Identify needs as they 
relate to curricula. 
Prepare evaluation cri- 
teria for curricula. 
Identify curricula moat 
approprite tb this pro- 
JecL 



Use of identified 
ment and curricula in each 
'classroome 

Portage Project 
. Early l^P 

Dev. Programming for 

Infants and Young 

Children 

COMP Curriculum 
EMI A a a a asmant Scale 
Individually wrItUn EP 

- Hawaii Early Learning 
Program 

Koontz Child D#valopmar.i 
for First 46 Months 
RIDES Assaasment 
Peabody 

Use identified tools and 
and curricula in each 
classroonv 

Portage Project 

- Early LAP 
COMP Curriculum 
Developmental Program- 
ming for Infants and 
YoOng Children 
Minneaota Child Dev. 
Scales 

Rockford Infant Develop- 
ment Scale (RIDES) 



EVALUATION 
Satisfaction and Change Data 

Curriculum uaad most often 
by instructors' with explana- 
tion for use. 

Satisfaction forms complatad 
annually by prbjact staff. 



Change datai child acquisition ^ 
of sIcUls through 1£P^ sum- 
marized in quarterly reports 
written by instructorsi OTt PT 
and CDS. 

Bavley, Millar scores sccompany 
quarterly reports. 



Chanqei frequency of use of each 
one by i:lassroom instructors in 
s 12«nx)nth period. 
Satisfsctiont Feedback forms 
from instructors and parants» 
indicsting sstisfaction with dpc- 
umanUtion of chUd% program 
plan. 
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PROGRAM 
ELEMENT TWO 



RATIONALE 



OBXCTIVES 



Sub Element: 
Curricula used for peer 
group Msessment 



Need for identification of 
assettment tools end conse- 
quent curricula for peer 
group arrangements to docu> 
ment movement and readiness 
for higher level peer group. 



Given the need fat a sequenced 

curriculum for each peer group 
to follow (senaoHmotorf cogni* 
tive perceptual motor^ toddler 
and preschpol) when they meet 
twice weekly, this element will 
identify those currlcuff^moat 
appropriate for the birth' to 3 
population. 



ACTIVITIES 



EVALUATION 
CHANGE 
Satiafaction OaU 



Define criterle for 
movement to each group. 
Determine purpose, fo- 
cus and needs of each 

^^l^nant staff wrltt^ 
curriculum with aanaor'- 
imotoc group for six 
nwnths; commercially 
prepared for 6 months. 
ImplAhant Coqnitivaly 
Oriantad for praschdS* 
pear group 
Implement Toddler 
Learning program with 
toddler group. 
Explore Plagetlan 
stagea and cognitive 
curricula for peer groups. 



Owngw Informal documentation 
of movement from one group to 
another. Pre/poattaet of group 
movement through curriculum at 
documantod bv Lteolrla^Hunt OrdI* 
nal Scalaa of Pavchoiooical 
Davalopmant In infancy. Etla*^ 
blishmant of criteria for each 
peer group provided by CommunI* 
cation OiaorderSpaclaltot. 

• Um df Plagatlan tasks to 
eveluaU ef tar child has 
reached the 24 month cogni- 
tive lavel on the Lteqiris* 
Hunt Scale. . 

Informal Cognitive Scales 

• Play Scalass SmUaniky, 
Paitofv Odonu 



Tabl«4A 



* EvaiiMtion of Sub Clement 



SUB ELEMENT 2,3 
CURRICULA USED FOR 
PEEft GROUPS 



CHILD 



PARENT 



STAFF 



DocumenUtion 



F ormel and written lEP 
appeert in eech chii<fi 
file. lEP includea ettett- 
ment data, tummary» retultt 
of interdisciplinary staf- 
fing program goals and 
responsible persons to im- 
plement. 



lEP sent to parent plus notifi- * 
cation of conference updates 
end each needed conference. 
Perent requests eny conference 
and consultation with thera- 
pists es often as desired. 



Cover sheet appeare in each, 
chiltfs file that acU as a 
checklist so primary Instruc- 
tors document needed Infornna- 

tlon. 

Written procedurdSi followed 
for updete of .lEP. 



Satisfaction 



N/A 



Satisfaction form is completed 
by each parent at conference 
updete snd initial lEP confer- 
ence. 



Primary instructors complete 
feedback form twice yearly* 



Change Data 



Individual to^ach child's 
skill acquisitToh. Quar- 
terly gains reported with 
narrative reports^ COS and 
and OT/PT reporU in each 
child'k.file. 



Parent reporting to Instructors 
and therapists. Coordination 
with home and center. Narra- 
tives pent to parents and pri- 
mary heelth care providers. 



In June I9ei» Instructors 
report their preference for 
curricula on feedback form. 



SUB ELEMENT 2.2 
CURRICULA USED FOR 
NONHANOICAPPED 
POPULATION 



Documentation 



Formally identified program 
plan appears in each child's 
file. 



Program plan sent to parents 
after discussion in initial 
conference. 



Responsible for documenUtion 
in individual file on speci- 
fic forms designed for pro- 
ject use. 



Satisfaction 



N/A 



Parents con)plete satisfaction 
form on a quarterly basis, j 



Primary instructors complete 
feedback form twice yearly. 
Re-evaluate in Spring V2. 



Change Data SkiU acquisition documented 

on program plan. Quarterly 
gains reported in written 
classroom narratives^ docu- 
' mented in each child's file. 



Quarterly narratives sent to 
parents and child^ primary 
heelth care provider. 



In June 1981, instructors 
report their preference for 
curricula on feedback form. 
Re-evaluate in Spring 1962. 
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Tata? 4A(oontkHMKl) 



Evaluation of Sub Clomant 



SUB CLEMENT 2«3 
CURRICULA USED FOR 
PEERGRCXJP5 



CMLO 



PARENT 



STAFF 



Oocumantotion 



Informal aMatsnwnt by COS 
and documantod ploc»mant in 
p#«r group arrangsmont. 



Information raportad in claat* 
room narrotiva to paranta. 



Appaart in aaoh planning 
foldar for tha tpacific 
groupt. All laaton plant for 
ona yaar. Formal list of 
•pacific cixricula and ra* 
tiooala for uta adoptad. 

Qroup critaria outiinad and 
impiomantad to facilitota 
movamant. 



Satisfaction 



N/A 



N/A 



Staff mambars rotata aach 
group during tha coursa of 
yaar so that aach axparianca 
the diffarant lavals of 
ability of groups. 



Change 



Documented move to subse- 
quent group on acquisition 
of skills and meeting mini- 
mum criterie for subsequent 
groups. 



N/A 



Rotetion of staff members on 
quarterly basis and discus- 
sion of satisfaction at staff 
maatings. Cognltivaiy Ori- 
ented Curriculum utilized to 
support the Plagatian frame- 
worlc of program. Results of 
Uzglrls-Hunt Informal Asses s 
ment lnstrun>ants nriatch the 
criterie for movement from 
one peer group to another* 
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PROGRAM 
ELEMENT THREE 

3.0 Parent Involvement and 
Systematic Inclusion of 
Both Populatione 



RATIONALE 

A need for parents of nor- 
mally developing and handi- 
capped children to share 
their child's experience in 
the program. While the 
project provides thr envi- 
ronment for integreted 
learning experience. 



Table 5 

Clement Evaluation Thraei Pmnt Involvi 



OBJECTIVES 

Given the need for parent in- 
volvementt this element will 
define end develop the procedures 
for including both sets of 
parents by end of second pro* , 
ject year. 



3.1 Sub Element; 

Incenter Programming 



Need for parents to partici- 
pate in their chiid% inceo- 
experitfnce^ to strengthen the 
chiid-perent bond end keep 
communicetion lines open. 



Given the need for parent in- 
volvement in each child^ in- 
center experience^ stretegies 
will be developed to fecilitote 
individually that involvement 
by end of second project year. 



3.2 Sub Element; 
Home-besed 
Programming for 
Handicapped Child 



The need for e systematic 
program, to be provided for 
femiliee and their child for 
whom it is more epproprlete 
that such services be pro- 
vided in the home. 



Given the need for identified 
family units to be served in the 
home, systematic procedures will 
be defined and implemented to 
meet those needs by end of second 
project year. 



ERIC 



ACTIVITIES 



EVAI^UATiON 



Monthly evening parent 
meetings. 

Dally entry into note- 
book diary. 
Phone conferencee. 
lEP conferences quar- 
terly. 

lOP conferences quar- 
terly. 

IndlvidOel^teesiont with 
Home Specialist, 
interdieciplkiary aUff ingr 

Single parent coun- 
seling group. 
Joint ef forU with^ 
Dept. of Voc. Rehab, 
for mentally retarded 
adults. 

Notebook diary. 
Parent %vork parties. 
Monthly parent educa- 
tion meetings. 
Participetkm ki Parent 
Advisory Committee. 
Spec^kiterest groups. 

Use of Individualizing 
Parent Programs. 
Use of Caldwell Home 
Inventory in pre-post. 
Development of criter- 
ion-referenced parent- 
ing skills program. 
EP developed for eech 
handicapped child in- 
volved in home^ased 
programming. 
Tuaion of kicenter and 
ho m e b a sed program where 
applicable (i.e^ 
perent meetkigX 
Use of Parent Behavior 
Prograssto n instrunrwnt 
for tndivii 



lividual I 
Use of Parentkig Skills 
Curriculum developed by 
Project SUff. 



Parente complete eftisf action 
form at end of each meetkig. 
Number of entriea on monthly 
basis, percentage of use by 
all families In program 
quarterly. 

Oocumantetkm ki cMkfs file. 



Summary of parent eatlsfec- 

tion forms. 

Percental of total partici- 
pation In kidivktual prpjada. 
designed to meat their OMds. 
Needs a s sass m o n t administered 
annually to parente for pur* 
poses of plemlng eUbeaquant 
years' parent aCtlvltlaai 



Pre and post IHOME admka- 
stretion to document perent 
changes. 

Programming with data based 
and criterion referenced 
individualized programs. 
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Tibto 5(cdntini«d) 



■r 



PROGRAM 
ELEMENT THREE 

3,3 Sub Elemenb 

Curriculum Development 
for parenting skills 



RATIONALE 

An Identified need for e 
parenting skills curriculum 
that addressee the ifidividual 
needs of the retarded parenL 



OBJECTIVES 

Given the need for a parenting 
curriculum for retarded parents '. 
who have a child at risk for nor- 
mal development^ a sequence and 
data based set of competanciat 
will be dev^oped to move the 
parent through a aeries of skill 
acqulsitlOHt based upon their 
need to know. 



ACTIVITIES 

Experience based, cri* 
terion referenced 
activities for each 
curriculum component 
(i.a. health and 
'Safety* nutrltlon« be- 
havior management). 



EVALUATION 

Acquisition of skills through 
curriculum oo^nponants. with 
80% criterion for aachoompo-^ 
nen|. 



ON 
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evaluation of Sub £fomont 



SUB eLCMCNT ^^ and 3.2 
INCCNTEK PROGRAMMINCi 
HOM^^ASCD PROGRAM- CHILD 
ING 



PARENT 



STAFF 



Oocumantotion 



lEPInooch childVfilo. 
Coordination with naads of 
paranta (working pitanttt 
tKHna-batadt combination pf 



Documantation of tpacific 
i^volvamant idantifiad to ba 
approprlata to naadt of 
parantf ^baaad on Initial 
agmimanta will appaar in 
aach parant and/or child 
fila. 



Rasponaibia parfona 
ciaarly idantif ia(4r i.a. 
Noma Spacialltta ara pri- 
marily ratponaibla. 



Satlafaction 



N/A 



Parant tatitfactlon. forms. 
Numarical rating attignad 
for aasy aummativa raportlng. 



Monitoring and raport 
writing avaluatad on form 
twica during aacond and 
third projact yaara* 



Changa 



Raflactad in ICP prograat. 



- Monitoring of writtaa parant 
programa. 

- Graphing raaultt. 

- HOME avaiuationt ooi^p^and 
post batit. 

- Graphing ratultt. 

- Ma Too pra and post tcoras. 



- Homa Spacialist ratpontibia 

- IHoma^Spaciallst ratpontibia 

- Homa Spaeiailat ratpontibia 

- Homa Spacialist rasponsibia 
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ElmTMnt Ewluation Foun Staff 0«vtk 



PROGRAJw< s 
ELEMENT FOUR 



RATIONALE 



OBJECTIVES 



4.0 Staff Development in 
Integrated Programming 



A need to Identify thoee 
characteristlct and competen- 
cies for project staff, that , 
facilitate the4eaming en- 
vimoment in an integrated 
program. ' 



' Given t5e need to identify char- 
ecteristics and competencies, 
the project will complete e 
model during the second program 
^ear and refine it for replice- *^ 
tion during third project year. 



4.1 Sub Elenient: 

Charecteristics and 
competencies of teachers 
in integrated population 
prbgrarnming 



4.2 Sub Element; 

Charecteristics and com- 
petencies of therapists 
in integreted progremming 



A need to identify those 
cherecteristics and competen- 
cies that facilitete the 
learninq^environment in an 
integretlid progrem. 



No identified source demon- 
stretes the skills necessery 
for therapists in an inte- 
greted setting. 



Giyen the need to identify steff 
charecteristics, sl<ills and com- 
.petencies, the project will com- 
plete e model during the second 
progrem year and refine it for 
replicetion during third project 
year. z 

Given the need to identify those 
skills and competencies of pro* 
fesslonal staff working in non- 
traditional educetional settings 
an outline will be developed to 
eddrees those needs* 

Given the need to identify com- 
petencies and characteristics of 
therapists working in an inte- 
greted setting, the project will 
identify end formelize those 
competencies in projeci; years 
two and three. 



4.3 Sub Element: 

Ineervice treining end 
consequent results 



A need to continue upgjreding 
current skills and introduce 
those necessary for the inte- 
greted learner populetion. 



Given the need for ineervice 
treining to improve and ecquire 
skills, the project will select, 
arrange and n>onitor training 
ectivities, bated upon identified 
needs, and document results of 
implempntation during project 
^ years two and three. 



ACTIVITIES 



EVALUATION 



SystwieticaUy use the 
SkUMpventory for 
Teaotidrt .aa a besis for 

individual Instructor 
plan. 

Baaed upon inseryice 
needs, identify com- 
petencies and skills in 
format. 

Identify the specific 
skills thet are differ- 
ent Iwceuse It is an 
integreted prt^am. 
Ploject steff completes 
forms defining their 
own perception of re- 
quirefl skills. 
Summary report genere- 
ted. 



Document usefulnes s of exiat- 
ing material used for asaese* 
ment every 4 montha. 
Conv>l«tMl liat et the end of , 
second Vmt* 

Working model to demonitreta < 
howto ecsuire ekllfe at tliird 
year% end. 



June 1982, document the tkUls 
as idenUfled by pitMect etaff 
in conjunction with the SFT 
checklist. SpMSlflcelly 
notk>g the sklUa n e c aeaa r y 
tor integrated program In full 
dey setting. 

Third project yeer, formalize 
kito ■'Suggested Competenciee 
for Steff Delivery Services 
in nontraditionaL" 



Solicit infomMtion 
from therapists that is 
outside the reelm of 
specific competeru:les 
in therapy training. 
Visit other^progrems. 
Solicit informetion 
' from training programs 
et university level. 



Solicit needs i 
nients twice yearly to 
'project staff. 
Acqueint steff quer- 
tiirly with project 
objectives et steff 
meetings. 

Bimonthly self-review 
of lesson plens. 
Treining menual devel- 
oped. 



Compile, cetegorize and refine 
competencies* 
Self evaluation of therepUiU 
and specialists. 
ProjSMCt report on the identi- 
fied ikllts, competencies end ' 
ettltudes of therapitU 
working in a non-treditional 
settk>g with other than achool 
age populetion. 

Through observetion and avelu- 
etion of needs survey, the 
needed treinkig to identified. 
Quartarly ateff meetings to 
evaluate if skllla er* com- 
plete to nneet project objec- 
Uvee. 

Evaluata ineervice sess i o n s 
with numbered queationneire. 
Graph participation and subse- 
quent use of skills end know- 
ledge In classrooms* 



PROGRAM 
ELEMENT FIVE 



Tabia 7 

Element Evaluation Tivai Coordination With Existing Community Programs 



RATIONALE 



OBJECTIVES 



ACTIVITIES 



EVALUATION 



3.0 Coordination With Existing 
• Community Programs 



5.1 Sub Eiemefit; 

Educational agencies 



5.2 Sub Element! 

^ Health care agencies 



6. 



A need to involve other 
health care professionals, 
educators and appropriate 
personnel in the comfpunity- 
based project, so af to in* 
crease awareness and use df 
generic services by project 
staff ahd create resources 
for parents' use* 



Educational training programs 
in this area (University of 
Washington, Seattle U., 
Seattle Pacific Ut^ community 
colleges) need to be aware 
of opportunity for field 
placement for students. 



Health care training institu- 
tions and providers need to 
be aware of services provided 
to enhance their outreach 
efforts, provide community- 
based training and awareness 
to interns and to work coop- 
eratively with existing 
agencies. 



Given the need for community 
involvement, the project, during 
year two, will identify those 
agencies and systematically in- 
clude them in cooperative efforts 
to benefit mutually both pro-' 
grams. During year three, sys- 
tematic procedures for replica- 
tion will be formalized in a 
written form. 



Given the need for field place- 
ment of student teaciiers, the 
project director will negotiate 
formal agreements with appro- 
priate repreaer\tatives of 
teacher training programs* 



Given the need to provide future 
health care providers with oppor- 
tunities to work in the community 
and alternatives to hoapital- 
based training, the project di- 
rector will negotiate formal 
agreements with a mininujm of 2 
health care agencies and formal^ 
ize systematic procedures in 
written form during year three. 



Identify agencies in 
^ community that provide 
similar and related 
services. 

Contact key persons to 
arrange meetings, 
rbrmalize contacts on 
yearly basis* 
Establish individual 
agency criteria 'and re- 
quirementa. 
Create and Implement 
format to document parti- 
cipation of all aganciea. 

Contact key peraonnel 
and explain project 
goals. Mail written 
information. 
Establish criteria for 
studenu and master 
teachera that are com- 
patible with project 
goals. 

Establish procedures for 
student placement* ' 

Contact key personnel 
and explain project ' 
goals* Mail written 
information. 
Establiah.crlteria for 
students and master 
teachers that are com- 
patible with project 
goals. 

Establish procedures 
for student placement. 
Contact nursing dept. of 
of major' trainir>g insti- 
tutions* 

Provide public and private 
health care providers 
with written information 



r ormal written agreementa 
documented in fila> noting 
specific reaponalbllitiea and 
expectations* 

Graph particiiMtion levala of 
a^nciea* 

r ollow-up summary of benaflta 
on y^irly basis* 
Disseminate aatiafactlon form 
to cooperating agency for 
formal evaluation oi coopera* 
tiveafforta* • 



Review yearly with key parson- 

nel. Utilize aatlaf action 

feedback format* 

Utilize student feadbeek for- 

rpat* 

Graph individual yearly agency 
participation* 

Refine proceas and proceduraa 
Into modal component. 



Review yearly with key person- 
nel. Utilize satisfaction 
feedback format* 
Utilize student feedback 
format. 

Graph Individual yeerly agency 
perticipetlon. 

Refine process and procedures 
into model component. 
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PROGRAM 
ELEMENT FIVE 



RATIONALE 



OBJECTIVES 



ACTIVITIES 



EVALUATION 



Sub Element; 

Social Service Agencies 



Social service training pro- 
grams and providers need to 
be aware of services provided 
to enhance their outreach 
efforts, provide community- 
based training and awareness, 
and to work cooperatively 
with existing agencies. 



Given the need to provide future 
social tarvice providers with 
opportunities to work in'the 
community, the project director 
wiii negotiate formal agreements 
with appropriate representatives 
of social service training pro- 
grams. 



(Group Health, hospitals, 
health care cllnicaX 
Seek to eatabllah formal 
working agreements. 

Contact programs serv- 
ing young children in 
social service 
agencies. 

Contact Mental Health 
District officais. 
Contact CDS. 
Contact Child Welfare. 
Contact Seattle Youth 
Work Training* Programs 



Review yearly with key person- 
nel. Utilize tatlafaction 
feedback format. 
Utilize atudent feedback 

fomuit. 

Graph individual yearly agency 
participation. 

Refine proceas and procedurae 
Into model component. 



O 4 



Tabl« e 

ClmiMnt CvaluttUon Si» Child Cm Aid 



PROGRAM 
ELEMENT SIX 



RATIONALE 



OBJECTIVES 



6.0 Child Care Aid Curriculum 



there ii » need for aide* to " 
be involved in the project 
letting. Handicapped adultft, 
teenagers and senior citizens 
provide valuable services and 
require minimum training for 
aide roles. 



Given the need to train the indi- 
viduals in the classroom so their 
potential is fully maximized^ a 
curriculum will be written to in- 
clude necessary competencies and 
end of project year two. 



6.1 Sub Element: 
Adaptation for 
handicapped adults 



A need for the specific com- 
petencies to be acquired by 
the handicapped edult. So 
the adult may function in 
role as classroom aide. 



Given the possibility of a non- 
reader, usually auditorily or 
physically impaired, aij(le*s par- 
ticipation in the curriculum, 
specific adaptations need to be 
prepared for multiple use of 
basic curriculum in year two 
and refined in year three. 



6.3 Sub Element; 

Adaptation for youth 
and senior'citizens 



A need for specific competen- 
cies to be taught to young 
people and senior citizens 
working in role of aide. 



Given the limited skills and 
experiences young people exhi- 
bit in working with project ' 
learner population, the curri- 
culum will he adaptable for use 
by this population In project 
year two and refined in year 
three. 



ACTIVITIES 



EVALUATION 



Pre/poit teat admini- 
stered to document 
needs, determihe place- 
ment in curriculum and 
for docunwntatlon of 
skills acquired* 
Curriculuin written and 
implemented. 
Include final mestery 
level. 

Provide annotations for 
each competency a« it 
relates to each parti- 
cipants ability. 
Implement twice nuxithly 
moetings for formal 
group InstructicKu 
Basis for inatruction 
Is CMId Care Aide Cur- 
riculum and Comporlints. 

Provide annotations for 
each competency as it 
rellites t6 each parti- 
cipant's ability. 



Complete In year two. 
Refine and adopt final dl>aft 
In year three. 

Document use of curriculum 
and graph p iog r aaa of Indi- 
viduals during yMr two. 
Formal pre/poat aaiais m ent and 
curriculum avallible for dia- 
seminatlon andl^ioatlon In 
in year thra*. 

Document use by persons with 
specific Impalrmenta, 
DocumanI and graph final 
mastery leval in currioitum by 
end of third ye«r« 
June 19S2» second year, docu- 
ment level of nneatery within 
the curriculum for aech 
involved adult client 



Oocument^use by persons with 
specific Impalrmentt. 
Document and graph^inal 
meatery level'ln oiirriculum 
for each individual Involved 
in two project years. 
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ei«m«nt Cvalimtion Smvf Child Nutrition 



PROGRAM ' 
ELEMENT SEVEN RATIONALE OBJECTIVES 



7.0 Child Nutrition 



Child nutrition ii a compo- 
nent not specifically focutod 
on in prograrm for handi- 
capped children. Because 
thii project ii a fuH day 
program, the issue of nutri- 
tioh can be focused on and 
'systematically planned. 



Given the naed for two meals 
daily to be provided to the 
learner populatioot a nutrition* 
' ally sound component will be 
developed, implementedi criti- 
qued, refined and prepared in 
years two and three that reflects 
the needs of the birth to three 
population of nonhandi capped and 
and handicapped infants and tod- 
dlers* 



7.1 Sub Element: 

Research into effects of 
medication on diet 



Difficulties can arise from 
lack of communication, lack 
of information and coordina- 
tion of commonly used medica- 
tions for handicapped chil- 
dren and thin relationship to 
the child^ d et. A proce-* 
dure for d»lm collectioh and 
coordination with existing 
information needs to be esta- 
blished. 



Given the need for a more compre- 
hensive approach to this need, 
the Project Director, Cook and 
Nurse will secure information 
from appropriate sources at the 
University of Washington, sum- 
marize information and prepira 
procedures and implement an 
action plan. 
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EVALUATION 



Parent faadback forma. 
Claaaroom faadback forme. 
Include plate w«tt« atudiea by 

senior nutrition atudants. 
Nutrition consultation for In^ 
dividual chUd that coordi- 
nates home and center efforts. 
Tinal documentation In graph 
form.'' 

June 1983, nutrition component 
complete In written form to be 
disseminated to Intereated 
programs. 

June 1982, rough draft of plan 
and procaduraa conripleted. 
Reviewed by appropriete ra* 
source persona for accuracy 
and usefulness. 
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IMPLEMENTATION PLAN 
PERSONNEL 

a* Who will conduct evaluation 
b« Design 



ELEMENT I 



a« OaMTOom Instructors and Thera- 
pists 

b. Individual Program Plans and 
assassmant instrument updated at 
designated intervals. 



c« Select/develop instruments 



c. Selection of most appropriate in> 
struments by Instructors 



d. Collect/analyze data 



d. Instructors, Therapists 



je« Critique summary reports 



KEY DATES OF ACCOMPLISHMENT 



e. Insthjctors, TherapistSy Project 
Director 



a. Instruments selected/developed a* Quarterly evaluation for each enrol" 
planned led child after initial assessment 



b* Data collected 



b* Quarterly for each enrolled child 



c« Analysis/reports written 



c. Quarterly for each enrolled child 
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Tablte 10 

M IMPLEMeNTATION 



ELEMENT 2 



ELEMENT 3 THROUGH ELEMENT 7 



Project Directory with information 
from Instructors 

Instructional Taaiins use minimum of 
one new instrument each time a new 
child is assessed with the required 
3 instruments 



d« Instructors collect data for final 
analysis by Project Director apd/or 
external evaluation. 

e* Instructors and Project Director 



a« Home Specialist and Projact Director 
and Nurye 

b« Annual evening parent program planned 
for 10 months» baaed on parent needs 
survey. Program plans for family 
units served by Home Spaclallat 

c. Instruments selectod and dealgned, 
baaed upon needs of piraU pivtici* 
pants. Instrument criteria will be 
initial aaseasmantt programming in- 
formation and evaluation dealgn 

d. Quarterly 



e. Home Specialist and Project Director 



a. Instructors will perform ongoing 
critique and use of newly acquired 
instruments 



b. Annually by Project Director 



c. Annually at a minimum 



Year end, final program evaluationy 
program satisfaction forms and annual 
parent needs asaeesment will be the 
preferrod documentation through sum* 
motive data 

CP and lOP conferancat quarteriy 
for program satisfaction fdrms^ annu- 
ally for aummative reports. 

Summativei Graph and narratives mid 
year and annually written aummative 
reports 
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PROGRAM IMPLCMCNTATiON (CONTINUED) 



IMPLEMeNTATION PLAN 
MONITORING RESOURCES 
a* Need consultation 

b. Assistance 

c. Materisls 



ELEMENT I 



a. As determined by project staff and 
approved by WESTAR 

b» If needed, approved by Project 
Director and/or WESTAR 

c. Printed; seminars; inservice train* 
ing 



HOW WILL EVALUATION BE MONITORED? 



Who will monitor the evaluation 
proceedings of all program 
elements? 



a« WESTAR identified consultant will 
provide aasistance to Project Direc- 
tor through identified criteria that 
relates to overall program design. 
WESTAR Technical Assistant will as- 
sist with overall evaluation moni- 
toring ^ 

b. External evaluator will provide cost 
analysis/effectiveness data and 
program effectiveness through child 
change data 



ELEMENT 2 



a. As determined by Project Director 



b. As determined by Project Director 



c. Assessment instruments and biblio- 
graphical material 



Project Director and project staff 
will cooperatively monitor the use 
of assessment and development of use 
of curricular materials. External 
consultant could be utilized through 
WESTAR technical aasistance 



b. Same as Element 1.2 



ELEMENT 3 THROUGH ELEMENT 7 



a« As determined neceaaary by Home 
SpecialiaU and Project Director 

b« Consultation 



c. Curricule end esaMsment toola deemed 
epproprietei evaliMtion deaign and 
individual program monitortng 



Project DirectOTt Home Specielista, 
Nurse and identified external con- 
sultsnts will monitor ongoing evelu*- 
etSon |>mcedures 
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